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Res uine' 



Name: Gene V Glass 

Address: Laboratory of Educational Research 

University of Colorado 
Boulder, Colorado 80302 

Home Address; 2860 Colby Drive 

Boulder, Colorado 803(^2 

Rhone: Office: 1 , ':xt . 7922 or 6935 

liome : 303-^^^'A787 

Date of Birth; 19 June 19^0 

Place of Birth: Lincoln, Nebraska 

Wife's Native: Sharon Lea Class 



Children: Julie Evann Glass (born 18 October 1963) 

Educational Record: 



1958-1960 

1960-1962 



1962- 1963 

1963- 1965 



Nebraska Wesleyan 

University of Nebraska (BA with honors from Teachers 
College; major--Gennan, iTiinor--matherrjatics ; teaching 
certif icate) . 

University o: Wisconsin (MS in Educational Psychology). 
University of Wisconsin (Ph.D in Educational Psychology 
with minor in Statistics) . 



Graduate 

Cours e 

Educ. Meas 
Statistics 
Math. Statistics 
Probability Tiieory 
Factor Analysis 
Measurement Dicory 
Test Theory 
Factor Analysis 
Analysis of Variance 
human Learning 
Seminar in learning 
Computers in Social Sciences 
Seminar In Learning 

Honors: Winner of Ariorican Institute 

for tl^o area of Measurement 



Courses Taken 



Instructor Year 



J . C , Stanley 1962 

J. C, Stanley 1962 

N. R, Draper 1962 

J. Coleman 1962 

C. W. Harris 1963 

J. C. Stanley 1963 

F. M. Lord 1963 

H. F. Kaiser 1963 

N . R. Draper 196A 

T. Jolinson 196A 

h. Klausmeiei* 196^4 

F. B. Baker 196A 

T. Johnson 196A 



for Research Creative Talcnc Award 
and Evaluation for 1964-1965 . 



Member of Delta Plii Alpha - German Honorary Society. 
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Employmen t His tory : 

Co-Director, Laboratory of Educational Kc^f5carch, Colorado University, June 19b7- 
present . 

Associate Professor, School of KducaClnn, Colorado University, July l9bB-preHC*nt , 

Assistant Professor, School of Education, ColoradT University, June 19b7-June 
1968. 

Assistant Professor, Department of Educational Psychology, University of 
Illinois, September 196‘^-June 1967, 

Assistant Professor, Research, CIRCE, College of Education, University of 
Illinois, September 1965-June 1967. 

Visiting Lecturer, School of Education, University of Wisconsin-Mi IwauVxe, 

June 196^-Ecbruary 1965. 

Research assistant. Central Wisconsin Colony (an institution for the mentally 
retarded), ILadison, Wisconsin, June 1963-f^eptember 1963, 

Teaching assistant, ilepartment of Educational Psychology, Laboratory of 
Experimental J^esign, University of Wisconsin, June 1963-August 1963, 

Project assistant, Department of Educational Psychology, University of 
Wisconsin, February 1963-June 1963. 

Research assistant. Department of Educational Psycliology, Unlveisity of 
Wisconsii;, June 1962-August 1962. 

Teaching assistant. Department of Educational Psychology, University of 
Wisconsin, February 1962-August 1962, 

Research assistant, Department of Educational i'sychology and Measure:. ent , 
University of Mehraska, Septemher 1 962-Eebruary 1962. 

Mem bershi p in Professional Orga niz ations : 

Psychometric Society 

American Educational Research Association 
National Council on Measurement in Education 
Phi Delta Kappa (Men's Honorary in I^ducation) 

7imerlcaa Psychological Association 

bile a^i o n^ : 

1962: 

Glass, C,, V. and Stanley, J. C, Effects of Correction for Differential 
Omissions Uj? ljl£ l^^temal Consistency of T ests . Fhaper presented at liie 
annual convention of the Psychoromlc Society, 27 August 1962, St. Louis, r.’o. 

1963; 

Glass, G. V. (Ji anc o Sus^ cc SjScs and the Reliability of Tests . Itadlson, Wis.: 

Dept, of Educ . Psych., Univ. of Wis., 1963, Unpublished blaster's thesis, 

51 pp. 

Stevens, II. A,; Sindberg, R, II.; Morgan, Jean K, ; and (;lass, G, V. A St udy 
o_f tju} Ex L end or R ole for Pro f ess iona 1 Lurs es-Pl l ot Phare > Paper presented 
at the annual convention of the Great hakes Region, American Associatiori 
of Mental Deficiency, October 1963, Northvllle, Mich, 
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Glass, G. V and Baker, F. b, Mno r aouic Devic e for Computing Su:ns of Squ a res 
in the Analysis of Varianc e. Occasional Paper No. 3. Madison, Wis.: 

Glass, G, V and Stanley, J. C. Review of Van Dalen and Meyer's Under s tandin g 
Educational Research . Lduc * and Psycho l. Meas * 23; 1963. Pp. 217-219. 

Glass, G. V and Stanley, J. C. Review of Ray's I ntroduction to Experimenta l 
l^tiuc ^ and Psychol . Meas * 23; l'^63. Pp, 207-208. 

Stanley, J. C. and Glass, G, V. Review of Hammond and Householder's int ro - 
ductio n to the Statistical Me thod . C omtemp . Ps ycit . 8; 1963. Pp. 37^-375. 

Glass, G, V, Review of Veiuberg and Schumaker's Statis tics: An I ntuitive 

Approach . Kdu c . and Psychol . Meas . 23; 1963. Pp. 8<!i9-851, 

196A: 

Glass, G. V and Wiley, 1). E. Formula Sc oring and Test Keliabl 1 Ity , Paper 
presented at the joint convention ol the ARRA atid February 1964, 

Chicago, Illinois. 

Glass, G. V and Harris, C. W. F actor ^n^l^sj^ of Trvie Scores . Fapar prepared 
for the Working Group on Factor Analysis, December 1964, Urbana, 111. 

Harris, C, W. ; Glass, G. V; and Melnke, D. h. Repeated Measures Analysis in 
Experiment s iji Learning . Paper presented at the annual convention of the 
American Psychological Association, 1964, Los Angeles, Calif, 

Glass, G, V and Wiley, D. E. Formula Scoring and iest Reliability. Jour . oj^ 
K duc . Meas . 1; 1964. Pp, 43-49. 

Glass, G, V. How may Salience of a Membership Group be Aroused? J our , ^f Edu c . 
Meas. 1; 1964. Pp. 123-129. 

Glass, G, V and McLean, I , D, A Posteriori Correction for Guessing in 
Recognitive Tasks. Amcr . Jout . £f P sych . 77; 1964, Pp. 664-667. 

Glass, G, V and Wiley, D, £. Review of Hays's Statistics for Psyc holo gists, 

Kduc . ar^ Psychol . Meas . 24; 1964. /’p, 724-726. 

Glass, G, V. Review of Edward's Expected V alue Di scre te Random Vari ables 
and Elementary Statistics, L duc . and Psychol , Meas . 24; 1964, Pp . 969-971. 

Stanley, J, C, and Glass, G. V. Review of Thorndike's C oncepts of Gvg£' 
and H nderachicvcinc n t . Teacher ' s Col lege R ecord 66; 1964, Pp, 282-284. 

1965: 

^Uass, G, V, A JhiJlhADil ^blc Analogue of Implications Sliorc - 

cut Item Analysi s . Paper presented at the annual joint convention of 
AERA-NCML, February 1965, Chicago, 111, 

Glass, G. V. Evaluating Testing, Maturation, and Gain Effects In a Pretest- 
Post test i^uasi-Experimental Design. Amcf . };d u c . Jour . 2; March 1965. 

Pp. 83-S7. 



Glass , G . V . The Resoluti on of Co mplexes of Inf alllMe Variables Into 

Common Factor s and Frincipal Components. Madison, Wla.: Uept . of Kduc. 

Psych., Univ. of Wis., May 1963. Unpublished Ph. D. thesis. 188 + vi pages. 

Morgan, Jean R. ; Glass, G. V; Stevens, 11, A.; and Sindberg, H. M. A Study of 
an Extendor Role for Nursing Service Personnel. Nursing Research 14, No. 4; 
Fall 1965. Pp. 330-334. 

Glass, G. V. A Ranking Variable Analogue of Biserial Correlation; Implications 
for Short-cut Analysis. Jour . cdE Educ . Meas . 2; 1963. Pp. 91-96. 

Glass, G. V. Discussion of P apers by Ca mpbell , Phillips , Stanley , and Yec . 

Paper presented at the Division 15 Symposium on Experimental and Quasi- 
experimental Designs in Psycho^ educati onal Research, at the annual 
convention of the American Psycliologlcal Association, 5 September 1965, 
Chicago, 111. 

Glass, G. V. and Mattson, D. C. Review of MoulyVs The S cience of Educat i onal 
Res earc h. Educ . and Psych . Meas . 2 d; 1965. Pp. 260-262. 

1966: 

Glass, G. V. D iscovery Facto rs in Teache rs ' Perceptions of Students . 

Paper presented at the 50th annu il meeting of the American Educational 
Research Association, 17 February I960, Chicago, 111. 

Glass, G. V. Testing Homogeneity of Variances, Amer . Educ . Res . Jour . 3; 

No. 3; May 1966. Pp. 187-190. 

Class, G. V. Note Concerning Rank Biserial Correlation. Educ . and Psycho l. 

Meas , 26, No. 3; Autumn 1966* Pp. 623-631. 

Glass, Gene V and Robbins, Melvyn P. A Cri t ique of Experiments on the Role of 
Neurological O rgani z ation in Readin g P erformance . Curriculum I^aboratory 
Working Paper No. 6., Urbana, Illinois: Univ. of Illinois, October 1966, 

70 pp. 

Glass, Gene V and Taylor, Peter A, Factor Analytic Methodology. Rev . of Educ . 
Researc h 36, No. 5; December 1966. Pp. 566-587. 

Stake, R. E. Glass, G. V; and Taylor, P, A. Report of the Eva luati on of the 
A ERA 1 966 Presession on Design of Edu c ational Experiment s . Urbana, 111. : 
Center for Instructional Research and Curriculum Evaluation, Univ. of 111., 
1966. 95 pp. (Mimeograph.) 

Glass, (;ene V. Alpha Factor Analysis of Infallible Variables. Fs ychometrlk a 
31; December 1966. Pp. 545-561. 

Glass, Gene V. Consequences oj_ Failure to Meet the /j*su mpl Ions Underlying 
the Analysis of Variance , Urbana, 111,: College of Education, Univ. of 

Illinois, 1966. 37 pp. (Mimeograph.) |a review of the literature.^ 
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Glass, Gene V and Maguire, 0, Abuses of r'actor Scores. Ame^. Kduc . 

I^es. Jour . 3, No, 4; 1966, i'p. 297^304, 

Glass » Gene V and Map,uire^ Thomas O, Review of Ferguson's Stat ist ical 

Analysis in Psychology and Education, Educ, and Psychol. Meas , | Winter 

1966. Pp. 1075-1078. 

1967: 

Robbins, Melvyn P, and Glass, Gene V. The Doman-Delacato Rationale; A 

Critical Analysis. Research Paper Mo. 2, boulder, Colo.; Lab. of Educ. 

Res., Univ, of Colo., August 196/, 43 pp, 

Maguire, Tnomas 0. and Glass, Gene V. Comp, me nt Prof i le Analysis — ^ A1 ternac ive 
If* PPGF . Research and Information Report, Uiv. of Educational Research 
Services. Edmonton, Alberta, Canada: Univ. of Alberta, October 1967. 

Class, Gene V and Robbins, Melvyn P, A Critique of Experiments on the Role 
of Neurological organization in Reading Performance. Research Pape r 

4. Boulder, Colo.; Lab, of Lduc. Research, Urilv, of Colo., October 

1967. 70 pp. 

Glass, Gene V. Review of Kducat ional ! -Meas uremen t foj; the Cl as si Te ache r 
by Smith and Adams. i^duc at io nal Forum 31, No, 2; 1967, Fp, 245-246. 

Hillman, Jason and Glass, Gene V. Rules of Thumb for Writing the ANOVA Table. 
Jour, of Educ . Mc^s, 4; 1967. Pp, 41-51. 

Glass, Gene V, Factors in Teachers' Perceptions of Students. Jour . oJ_ Educ . 

Meas . 4; 1967. Pp, 87-93. 

Glass, Gone V and Robbins, Melvyn P, A Critique of Experiments on the Hole 
of Neurological Organization in Reading Performance. Re ading R esearch 
Quarterly 3; 1967. Pp. 5-51. 

Maguire, Thomas 0. and Glass, Gone V, A Program for the Analysis of Certain 

Time-Series Quas i-Exper 1 mLU ts , Ihhjc, and Psychol . Meas . 27; 1967, Pp, 743-750, 

Glass, Gene V. Keviev* of Kozebootn's F oundatio ns of the Theory of Prediction . 

Arne r . Educ . Res . Jour . 4, N'o, 4; 1967. Pp. 398-401 . 

Glass, Gene V. Re.'iew of Rermers , Gage, and Rummel's A Prac tica l I ntroduc t i on 

^i^as urem ent and Eval uatio n, E ducatio nal Forum 31; March 1967. Pp, 372-373, 

1908: 

Glass, Gene V. RCflectluns on Bloom's ’’Toward a Theory of Testing wliich Includes 
Measurcmont-Evaluat ion-Assessment , " Paper read at the Symposium on Problems 
In the Evaluation of Instruction, December 13-15, 1967, Los Angeles, Calif, 
UCLA. (Also appears as Research Pape r No , 8, Boulder, Colo: Lab, of Kduc , 
Research, Unlv. of Colo, Oecenbe.r 1967, and ?3 Occasional P aper UCLA, 

Center for the Study of Evaluation, September 1968.) 

Maguire, Thomas <), and Glass, Gene V, Component ProflJe Analysis (COPAN)--An 
Alternative to PROF, and Psychol . 28, No, 4; Winter 1968, 

Pp. 1021-1033. 
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Glaas, Gene V and Maguire » 0. An alysis of Inte rrupted Time-Ser to s 

Kxpcr imcnt s. Paper presented at the annual meeting of the .\nierican 
Educational Research Association, S Vohruary 1968, Chicago, 111. 

Glass, Gene V and Maguire, Thonas 0. An alysis of Time-Series Quasi-Experiment s . 
Boulder, Colo.: USOE Report //6-8329, Lab. of Educ . Research, Univ. of Colo., 

May 1968. 

Glass, Gene V. Correlations with Products of Variables: Derivations and 

Implications ior Methodology. Arne r . Educ . Res. Jour . , November 1968. (Also 
appears as Research Paper No. 9^. Boulder, Colo.: Lab. of Educ. Research, 

Univ. of Colo., January 1968.) 

Glass, Gene V. Report of Uie Amer ica n ^!Liv Jca t ion^^l Research Assoc iatio n 196 8 

Program. July 1968, 365 pp. 

Glass, Gene V. Author's Guide and Style Manual for the Review* of Educational 
Resear ch ♦ Washington, D. C.: American Educational Research Association, 

August 1968, 37 pp. 

Glass, Gene V and Kakstian, A. Ralph, i'casures of Association in Gonpurat ive 
Lxper iments ; Tlieir Development and Interpretation. Researen Paper No. 14 . 

Boulder, Colo.: Lab. of Educ. Research, Univ. or Colo., September 1968. 

(Also presented at the annual meeting of AERA; Los Angeles, Calif. 7 February 1969.) 

Glass, Gene V. Two Generation's o_f i\*a luation Model s . Paper presented at the 

Nebraska i’ersonnel and Guidance Association Meetings, Lincoln Neb. September 29, 
1968. 



Class, Grene V. Educational Filtdo'^n Men. Phi Delta K appa , Vol . L, No. 3; November 
1068. Pp. 148-151. *■ 

Kracht, (Jlcnn li. and (Jlass, GoriC W 31ie External Validity of Experiments. 

Amor . Educ . Regj , Jou r . 5; November 1968. Pp, 4 37-^74. 

Hopkins, Kenneth D. and Class, Ceno V. Est hi ishing a Gradua te Research 

Tr ainin g Program and thje Laboratory of E ducational Research . Final Report 
USOE Project No. /<'6-1860* Boulder, Colo.: Lab, of Educ. Research, Univ. 

of Colo., November 1968. 



Glass, Gene V. Correlations with Products of Variables: Derivations and 
Implications for Metliodology. An^e r . Educ . Res. Jour . , Nov. 1968. 

Robbins, Melvyn P. and (ilass, Gene V, The Doma i-lJelacato Ration.ale; A Critical 
Analysis. Educatio nal Ih erap y , Winter 1968. 

Glass, Gene V. Analysis of Data on the Connecticut Speeding Crackdown as a 
Timc-Sorios Ouas 1 *Expcrimcnt . Law and Soc iety Review , Winter 1968. 

Glass, Gene V, Review of C. M, Lindvall's Measur ing Pupi ls ' A chieveme nt an^ 
Apt itude . Ihc Edu cational Forum 32, No, 2; I9?i*8, P,~251,^ ^ 



Hakstian, A, Kalpli and Glass, Gene V. 



Clini cal Psychology an^ Psyciilatry . 
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Review of Chassan's Resea rch JlcsI^n Ij} 
E^i\c. and P'j^chol, 28; 1968. Pp. 



621-623 
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Glass, Gene V. Response to Traub's ''Note on the ReliaM.it^ jf Residual Change 
Scores." Jour , of Educ > 'Aeas . 5, No. 3; 196S. Pp . 263-767 

1969: 

Stanley, Julian C, and Glass, Gene V. Simple Proo: LlioL the Sum of the 

Squared Lrrors in Estimating Y from ^ via b. and j is Minima", Ame rican 
Statistic ian, January 1969. Pp 25-26. 

Stephens, W. Beth; Glass, Gene V; McLaughlin, John / l ter, Charles K. 

IJna Factorial Structure of Re-^sonlng , >!oral Judg ont Conduct. 

Paper presented at the annual ineetinv of the Ameri i Educational ^Research 
Association, L^ u Angeles, Cal'^f,, 6 February 1969. 

Bauman, Danic, L. , Glass, Gei;e V; and Harrington, Scott A. Ihe Effects of 
tlie Position of an Organizer on Learning Meaningful Vord il Material. 

Resenrch Paper No. 24 . Boulder, Colo.: ! >b. of h(hj: . Arsi'^rcii, Univ. of 
Colo., January 1969. (Presented at the annual mecti- g o' AMXA, Los 
Angeles, Calif., 6 February 1969). 

Mendro, Robert L, and Glass, Gene V. The Approximate Sampling Dls w. Ibutior. of 
the Strattii -d Alpha Genet al izabi 11 ty Coefficient. Researc^^ 

Boulder, Colo.: Lab. of Lduc. Research, Univ. of Colo., January 1959. 

(Presented at the annual meeting of AERi\, Los Angeles, Cel if., 7 February 1969.) 

Glass, Gene V. lha Growtli of Evaluation Methodology. R esearch Pape r No. 2^, 
Boulder, Colo.: Lab. of Educ . Research, Univ. of Colo., March 1969. -5 pp, 

Peckham, Percy D.; Glass, Gene V; and Hopkins, Kenneth D. The Fxperinentai 

Unit in Statistical Analysis. U eseercti Paper No. 28 . Boulder, Colo.: Lab. 

of Lduc. Research, Univ, of Colo., Mav'ch 1969. 

Class, Gene V. P 1 a n f or Future of the Rev l ei? of L duuattona 1 Research. 

Paper prepared for the Associciion Council of the Arne: ican Uducationci 
Hescarcli As*socia t lop . April 1969, 12 pp. 

Ross» H. Lawrence; Campbell, Donald T.; Glass, C-enc V. The British Crackdown 
on Drinking and Driving: A Successful Legal Reform. Rese arch Paper No . 29 . 

Boulder, Colo.; Lab. of Kduc , Research, Univ. of Colo., May 1969. 30 pp. 

Glass, Gene V; Sanders, James K, ; and Jurs, Stephen G. Mastery Te^ Items 
L0£ Gourdes in Educationa l Rcsoarc)\ Methoc s . Boulder, Colo.: Lab. of 

Lduc. Research, Univ. of Colo., Jfay 1969. 42 pp. 

Glass, G. V. tiote on Jensen and Rohwer’s "Mental Retardation, Mental Age, and 
Learning, Rate,” Jo urnal of Lduc. Psych . .1969, 6^, 415-416. 

Collins, James R, and Glass, Gene V. Review of Baggalry's Mathera t ics for 
Introductory statistics, A Programmed Kevlev. Edue . and Psychol. Meas., 

Fall 196^ 

(ilass, c:ene V and Stanley, Julian C. Stat istical "let ho ds Educatio n and 

Psyc hol ogy. Prentice-Hall Publishing Company, 1970. 




9 



- 8 - 



Glass, Gene V,* Rojbins, Melvyn , and Tuinman, Jaap. DeJacato — Neurologische 

Organisatie en Leesonderwijs : Eon Kriclek. Pedago r,lsch Foruin . 1969, 265-288. 

Class, Gene V and Maiahlco Okada. An Analysis of Delacatc's Experimental 
evidence. Pediatric s. (in press.) 



Glass, Gene V and Collins, James R. Geometric Proof of the 



the Possible Values of c when 
Meas , (in press.) 



ana r 



ire Fixed. 



Restriction on 
Educ , And Psychol . 



Prof essional S ervic e : 

Consulting Editor, A meri can LducaLional Research Journa l , December 1965- 
February 1969. 

Advisory Editor, Journa 1 of Educational >fcasuren: cnt , November 1967- 

Consulting Editor, Ed ucational and Psyc holo gical Measur ement , October 1967- 

Editor, Revie w o^f Educational Research of the American Educational Research 
Association, July 1968-February 1^1, 

Instructor, USOE Institute in Experimental Design and Analysis, Unlv. ot 
Wisconsin, Surjiier 1965. 

Instructor, American Educatior.cl Research Association, 1966 Presession on 
Design of Educational ExperimenEs, February 1966. 

Instructor, Research Training Program for State Education Tepartment 
Personnel, Denver University, April 1967. 

Director, American Educational Research Association, 1967 Presession cn 
Design and Analysis of Comparative Experiments, Sept. 1966-March 1967. 

Director of Research Training Presession on Analysis of Variance Techniques, 
Conventio. of the American Vocational Association, December 2,3, 1967, 
Cleveland, Ohio. 




Instructor in Ar.;erican Educational Research Association Research Trainin'^ 
Session in Reading Research, February 3-7, 1968, Chicago, Illinois. 

Chairman, American Educational Research Association, Research training 
Presessions Committee, February 1 967-February 1968. 

Member of American Educational Research Association, 1968 Program Committee, 
February 1967-February 1968. 

Instructor in seminar in 'Strategics for Rehabilitation Research with the 
Retarded” held at University of Oregon, Pchabilitation Research and 
Training Center, in Mental Retardation, 16 December 1968. 

Chairman of Graduate Student Seminars Program, AERA Annual Meeting, 1970. 

Chairman, Educational Testing Sei sfice Invitational Conference on Testing 
Problems, 1970. 

Instructor in Workshop on Evaluation Methodology, Colorado State University. 

1. June 1969 EPDA Directors 

2. August 1969 State Department Personnel 

3. September l<^69 State Department Directors 

4. October 1969 EPj)A Directors 

Hucknell Undergraduate Education Research Advisory Eoard, April 20-2?, 1969. 
Fellow, Institute for Epistornic Studies, Mew VoeV University, August 1969- 

I U 
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Member of tiie Head Stare Research and Evaluation Committaej Office of 
Economic Opportunity, November 1967- 

Review Panel, Title IV of ESEA, IS65, USOE. 

Field Reader , Bureau of REsearch, U , S, Office of Education, 1966* 

Ad hoc reviewer for the following publications: 

1 . Sociological Methodology 

^ * Bri tannica Reviev of Aincr i can IMucat ion 

^ • AEKA Curriculum Evaluation Monograph Series 

4 . Psychometrika 

5 . P sycho l ogical Bulletin 

Consultant to tl;e following agencies; 

1. Dept, of Educ. Psych., Temple University 

2 . Uept, of Psychology, Northwestern Univeisity 

3. Project SESAME, Buckneil University 

4. Nebraska State Dept, of Education 

5. Social Sciences Education Consortium, Unlv. of Colorado 

6. Annua l Revi^ews, Iji£. , Palo Alto, Calif. 

7. Sou tliwes tern Cooperative Educational Laboratory, Albuquerque 

8. Colorado State Uept. of KducaLion 

9. University of Wisconsin Medical School 

10. U, S. Office of Education, Research Training Branch 
Jl. Regional Educational Laboratory, St. Louis, Mo. 



o 

ERIC 
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Recent Writings : 

Glass I Gene V (with Daniel J. Booth, James R. Collins, Jon R. 

Erion, Jerry G. Ho^n, Helen H. James, Loretta A, Shepard, 

Dennis R. Wing). Education of the Disadvantaged : _An Evaluative 
Report on Title ^ £f_ the Elementary and Secondary" Education Act 
of 1965 — Fi;^cal Year 1969 . Laboratory of Educational Reaearch, 
University of Colorado, May 1970, 670 pp. 

Burton, Nai^cy W. and Glass, Gene V. Review of Simon’s Basic 

Methods ijTL So cial g<pi encfi : The Art of Empi rical Investigation . 

Educational and Psyc hological M easu rement , Winter 1969. 

Glass, Gene V. A Colorado Sc hool L^^arni ng Assessment Program . 

Paper presented to the Committee co Public Education of the 
Colorado Legislature, December 9, 1969. 

Glass, Gene V. Desig n of Evalu ation St udies . (31 pp.) Paper 
presented at the Council for Exceptional Children Special 
Conference on Early Childhood Education, New Orleans. 

December 13, 1969. 

Wiley, David E.; Collins, James R.; Glass, Gene V. Sources of 
Variation in Multiple-Choice Test Performance. Research 
Paper No . 37 . Laboratory of Educational Research; University 
of Coloraio; Boulder, Colorado, March 1970. Presented at 
the Annual Meeting of tlie American Educational Research 
Association, 3 March 1970, Minneapolis, Minnesota. 

Glass, Gene V. Educational Knowledge Use. Address to Orientation 
Program for the U. S. Office of Education 1969-70 Postdoctoral 
Fellows. Elkridge, Maryland, 15 September 1969. Presented in 
revised form to the Special Interest Group on Research Utilization 
at the Annual Meeting of the /onerlcan Educational Research 
Association, 5 March 1970, Minneapolis, Minnesota. 

Sanders, Jarres R. and Glass, Gene V. Short - terra and Long-ter m 
^ E ffects Ad junct Questions in Attdio Discourse : An 

Extension of Researc h oi\ Hathemagenic Behavior . Paper presented 
at the Annual Meeting of the American Educational Research Assoc- 
iation, 3 March 1970, Minneapolis, Minnesota. 

Bracht, Glenn H. and Glass, Gene V. Aptitude-treatment Interactions iu 
Learnin g the Addition of Signed N umbers . (Submitted to the Journal 
Of Educational Psyc h ology .) Paper presented at the Annual Meeting 
oF the ^eriCiin^^ucational Rece^rch Association, 3 March 19/0. 
Minneapolis, Minnesota. 
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Glass, Gene V. Educational Measureraant: New Methods for New Roles. 

Education Co lorado , 

Part I: A change in the concept of measurement » Vol. 5, No. 13. 

March 1970. 

Part II: Binet testing approach was successful. Vol. 5, No. lA. 

March 1970. 

Part III: Testing to measure abilities differs from testing to 

evaluate programs, Vol. 5, No. 15. April 1970. 

Maguire, T.O.; Clark, A. K, and Glass, G, V. Individual differences 
in teachers^ perceptions of students. (22 pages). (Submitted for 
publication . } 

Glass, Gene V and Remer , Rory. Revlev? of David J. Fox's The Research 
Process in Education . Conte m porary Psychology , 1970, 15, 277-278, 

Ross, H. Lawrence; Campbell, Donald T, and Glass, Geni V, Determining 
the Social Effects of a Legal Rtforc.; the British ''Breathalyser" 
Crackdown of 1967. American Behavioral Scientist, 1970, March/Apri'*. . 
493-509. 



Recent Professional Serv ice and Research : 

Principal Investigator on "Education of the Disadvantaged: An 

Evaluative Report on Title, I of the Elementary and Secondary 
Education Act of 1965 — Fiscal Year 1969,'' December 1969-August 1970. 

Panelist on "Applications of Operations Research to Educational Evaluation.' 
Third Annual C.^erations Research Conference, National Bureau of 
Standards, Washingtoii, D. C. 7 May 1970, 

Awarded the Palmer 0, Johnson Award by the American Educational Research 
Association in December 1969 for the best publication in the 1968 
volume of the A merican Edu cational Research Journal . (Award given 
to Glenn H, Bracht and Gene V Glass as co-authors.) 

Consultant to University of Calif ornia-Santa Barbara on planning the Graduate 
School of Education, December 4-5, 1969. 
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NDEA Title IV Fellow in the Design of Experiments in Education, 
Department of Educational Psychology, University of Wisconsin, 
September 1962 to June 1965. 

Research and Project Assistant, Department of Educational Psychol- 
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Research Associate, Research and Development Center for Cognitive 
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Educational Development Center. 
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Director of four U. S. Office of Education Grants under Title 
III, Elementary and Secondary Education Act: Planning Grant 

Project SESA^\E, Project SESAME A (Arts) and Project SESAME G 
(Games), Bucknell University, varying starting dates, Septem- 
ber 1966 to August 1970 (on leave, September 1969 to August 
1970) , 



USOE Post-doctoral Fellow, Laboratory of Human Development, 
Harvard University, September 1969 to /august 1970. (Early 
childhood learning and development, evaluation and research 
methods, social intervention, motivation, attention, adminis- 
tration . ) 

Associate Professor, University of Colorado, September 1970 to 
present. 

Leadership Training Institute Early Childhood Education Fellow, 
Education Professions Development Act, September 1970 to 
pre sent , 

Memberships in Professional Societies: 



American 
American 
Ame r i can 
National 
National 
Phi Dolt 
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Kduca ti 
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Counci 1 
Society 
a Kappa 



tion for the Advancement of 
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ogical Associ at ion 
on Measurement in Education 
for the S tudy of Education 



Science 



Articles and Reports: 



Goodwin, William L. "Adjustment for Sex and Variability 

Differences on the Allport-Vernon-Lindzey Study of Values 
Profiles." Journal of Ed ucational Measuremen t , 1964, 

1, 55-S8. 



Goodwin, VJilliaiu L. "Effects of Selected Methodological 

Conditions on Dependent Measures Taken after Classroom 
Experimentation." Oournal of Educational Psychology, 
1966, 57, 350-358. 



Goodwin, William L. The Effect on Achievement Test Results 
of Va ry i ng Conditions of Experimental Atmosphere , Notice 
of Testing , Test Administration , and Test Scoring . Tech- 
nical Report No. 2, Research and Development Center fpr 
Learning and Re Education, Madison; University of Wiscon- 
sin, 1965. 

GooJwin, Willi aa\ L. "Using Control led Experimentation Effec- 
tively." PACE report , June-July J969, 2-5 

Goodwin, William L. , and Carrescia, Carole. "Project SESA>;E G 
Games as an Inservice Vehicle." Educational Te ^chnology , 
in press. 
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Goodwin, William L. , and Lambert, Pliilip. '^The Teacher Is 
Biased... At Best." Psychology in the Schools^ 1965, 

2, 169-171. 

Goodwin, William L. ; Joyce, Julianne; Abrams, Alan; Diaggio, 
Angela D . ; and Biaggio, Luis I. "Note: Relationships 

between Matching Scales of the Cattell 16 Personality 
Factor Questionnaire and the High School Personality 
Questionnaire." Journal of Educational Measurement, 

1965, 2, 220. 

KXausmeicr. Herbert J.; Cook, Doris M,; Goodwin, William L. ; 
Tag^itz, Glenn K.; and Pingel, Louis. Indi vidua 1 i zing 
Instruction in L anguage Arts thro ugh Deve lopment and 
Research in Uni ts of_ Loc a I Schools , 19 6 5-1966 . 

Technicaj Report, No. 19, p'esoarch and Development Center 
for Cognitive I, earning, Madison: University of Wisconsin, 

1967. 

Klausmeier, Herbert J,; Goodwin, William L. ; Prasch, John: 

and Goodson , Max R. "Project Models: Maximizing Oppor- 

tunities for Development and Cxperirnentatioii in Learning 
in the Schools.” Occasional Paper No. 3, Research and 
Development Center for Learning and Re-Education , Madison: 
University of Wisconsin, 1966. 

Klausmeier, Herbert J.; Goodwin, William L. ; and Ronda, Teckla. 
"Effects of Accelerating Bright, Older Elementary Pupils — 

A Second Follow-Up." Journal of Educational Psychology, 

1968, 5^, 53-58. 

Lambert, Philip; Goodwin, William L.; and Roberts, Richard F. 

"A Comparison of Interaction Variables in Team and Self- 
Contained Classrooms," Psychology in the Schools, 1965, 

2, 352-359. 

Lambert, Pliilip; Goodwin, William L. ; and Roberts, Richard F. 

"A Comparison of Pupil Achievement in Team and Self-Contained 
Organizations.'’ Journal of Experimental Education, 1965, 

32, 217-224. 

Lambert, Philip; Coodwii;, William L.; and Roberts, Richard F. 

"A Note on tiie Use of the Flanders Interaction Analysis." 
Journa l of E ducational Research , 1965, 5^/ 222-224. 

Lambert, Philip; Goodwin, William L. ; and Wiersma, William. 

"A Comparison of Pupil Adjustment in Team and Self-Contained 
Oi ganl zat ion"; . " Journal of Educational Research, 1965 , 

58, 313-314. 

Lamoert, Philip; Goodwin, William L.; and VJiersrr^a, V»illiam. 

"A Study of the Elementary School Team." E.1 erne nt ary 
S choo 3 Journal, 1965, G 6 , 28-34. 
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Olton, Robert J. ; Wardrop, Jaines L.; Covington, Martin V.; 

Goodwin, William L. ; Ciutchf ield, Richard S.; Klausmeier, 
Herbert J.; and Ronda^ Teckla. The Development of Produc - 
tive Thinking Skills in Fifth-Grade Children . Technical 
Report No* 34, Research and Development Center for Cogni- 
tive Learning, Madison: University of Wisconsin, 1967. 

Staats, Arthur W.; Minke, Karl A.; Goodwin, William L. ; and 
Landeen, Julie. "' Mot iv ated Le arning ” Reading Treatment 
wi t h Additional S ubjects and Instructional Technicians . 
Techincal Report No. 22, Research and Development Center 
for Cognitive Learr.ing, Madison: University of Wisconsin, 

1967. 

Tagatz , Glenn D.; Otto, Wayne; Klausmeier, Herbert J.; Goodwin, 
William L. ; and Cook, Doris M. ’“Effect of Three Methods 
of Instruction upon the Handwriting Performance of Third 
and Fourth Graders.” American Educational Research 
J ournal , 1968, 5, 81-90. 

V'Jardrop, James L. ; Goodwin, 'William L.: e^ "The Develop- 

ment of Productive Thinking Skills in Fifth -Grade Children." 
Journa l of Experimental Education , 1969, 32 / ( 4 ) , 67-77. 



Books and edited works: 

Goodwin, William L. (Editor) . Buckne 1 1 Conference on Learning 
Problems of the Migrant Chi Id . Lewisburg, Pa.: Bucknell 

University, 1967. 

Goodwin, William L. , and Cieslak, Paul J. (Editors). Buckre 1 1 
Conference on Faci li tatinq the Learning of the Migrant 
Child . Lewisburg, Pa.: Bucknell University, 1968. 

Klausmeier, Herbert J., and Goodwin, William L. Learnin g and 
Human Abilitie s: E ducationa l Psychology (2nd Edition) . 

New York: Harper and Row, 1966. 

Lambert, Philip; Wiersirta, v'Jilliam; Goodwin, William L. ; and 

Roberts, Richard F. Classroom I nteraction , Pupil Achieve - 
ment and Adjustmen t in Te^ Teaching as Compared with the 
Se 1 f- Contained Classroom , Office of Education Cooperative 
Research Project Number 1391, Madison, Wisconsin: Univer- 

sity of VJisconsin, 1964 . 



Papers presented; 

Goodwin, William I. "The Effect on Achievement Test Results 
of Varying Conditions of Experimental Atmosphere, Notice 
cf Test, Test Administration, and Test Scoring." Paper 
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presented at the annual meeting of the American Educational 
Research Association, Chicago, Illinois, Febru^ary, 1966. 

Goodwin, William L. , and Rubicam, Irvin R. "The Effects of 

Exemplary Models' Characteristics and Student Set on Resul- 
tant Student Preferential Actitudes." Paper presented at 
t]ie annual meeting of the American Educational Research 
Association, Chicago, Illinois, February, 1968. 

Goodwin, William b. , and Sanders,' James R. "The Effect of 
Selected Variables Upon Teacher's Expectation of Pupil 
Success." Paper presented at the annual meeting of the 
American Educational Research Association, Los Angeles, 
California, I'ebruary, 1969. 

Lambert, Philip, and Goodwin, Wi, Ilian L. "Interaction Varia- 
tions in an Unstable Team Organization." Paper presented 
at the annual meeting of the American Educational Research 
Association, Chicago, Illinois, February, 1964. 



Reviews : 

Goodwin, William L. "Review of Four Measurement Books." 
Educational Leadership , 1969, 829-830. 

Goodwin, William L. "School Interest Inventory: Test Review. 

Journal of Educational Measurement , 1969, 6^, 200-201. 
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Ph.Di, University of Southern California, 1961 (educt rieasurement 
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Postdoctoral Study, Laboratory of Experiricntal Design, University 
of Wisconsin, Sutrjrer Institute, 1965. 



Vocational History: 

Chemist, AC Cncnical Company, 1935-56 

Clicristry Teacher and Coach, San Karino Preparatory High School, 
1957-38 

Vocational Counselor, Veteran's Administration, USt Branch, 1958 
Psychologist, Hudson School District, California, 1958-60 
Visiting Lecturer, USC, 1959-60 

Assistant Professor, University of Southern California, 1960-63 
Associate Professor, University of Southern California, 1963-65 
Visiting Professor, University of British* Columbia, Summer, 196^ 
Associate Profensor, University of Colorado, 1965-68 
Director, Laboratory of Lducationa] Research, University of 
Colorado, 1966- 

Professor, University cf Colorado, 1968- 



Profcssional Associations and Activities: 




California Educational Research and Guidance Award for excellence 
in research, 1961 
Biometric Society 

American Educational Research Association (Div. C and D) ; .'enber. 
Committee on Collating and Disseminating Information on Research 
Ke thodology 

/Vncrlcan Psy diologi cal Association (Div. 5 and 15), Fellow, Div. 5 
(Measurew^nt and J^valuat ion) , 1968 
Certified Psycljologis t , State of California 
V\\i Delta Lambda 
Psychometric SocleLv 
A mo r i can ^jn of Sci ence , I9f>3- 
Wlio Vs VI lo In American Ihluca t Ion , 1968- 
Vlio's him ^ 196 3- 

Editor, Review Section, Journal of Educational Measurement, 1965-68 
Consulting editor, of Experimental Education, 1969-72 

Ke.ader, £q_unui_l of FducatT^^^ 1969- 
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Orange f'/juntv Sdiools, Califontla, 1962-65; Jefferson Countv 
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Scfiool District, l‘)67-; KivU School Goograp v PrtMCCt, P68-; 
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Vrofessionol Associations and Activities (com,); 

Research Abstractor, bUl Delta Kappa, School Hesenreh Information 
Service, 1967- 

Field Reader, li,S, Office of Education, 1967- 

Research Training Institutes, Instructor; USOE Training Institute 
for State Departir^ent Personnel, University of Denver, 1965, 

1967; Oklahorna ConsoTtium on Research Development, 1967; 
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The Diagnostic Use of WISC Subtest Patterns, California Journal 
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Problems in Interpreting Standardized Reading Tests, TWen ty-Fi f th 
Yearbook, Claremont Re ading Conference , Claremont University 
College^ 137-139, 1961. 

The Concurrent and Congruent Validities of the. Wide Range 

Achievement Test, Educational and Psychological Measurement , 
791-793, 1962, 

ITie Reliability and Predictive Validity of the liCe-Clark Reading 

Readiness Test, Journal of tx^veloprcntal Reading, 6, 2 77-281, 196 3. 
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Association of School Psychologists and Psychonetrlsts , 1963. 

An Knpirlcal Analysis and Critique of the Efficacy of the WlSC in 
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Journal of Genetic Psychology , 103 , 163-172, Septeinber, 196A 

Extrinsic HeJiablliiy: Estimating and Attenuating Variance from 

Response Styles, Chance and Other Irrelevant Sources, Educational 
and Psychological >!easurereai : , 2^, 2 7 1-2 81, 196 A. 

Evaluating Pupil Achievement: A Critical Look at ProvinL-l'l onJ 
Standardized Testing, The British Col umbia Sc hool Principa ls* 

Con ference , Fourth , )07''113, 196^. 

In ter individual and Intraindividual Positional Preference Response 

Styles on Abilitv Tests, Kducutionsl and Psvchological Measurement, 
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Comparative l>carnlng and Retention of Conventional and Instructional 
TV Methods, AV Cemmuni ca cion Review , _13, 2^-37, Spring, 1965. 

An Investigation of Theoretical and Empirical Chance Scores on 
Selected S tanclardlzed Croup Tests, C alifornia Journal of 
Lducat Iona 1 Research , 16 , 3^.-^l, 1965. 

Comparab 1 1 1 ty of Scores o\\ the Wide Range and the Gilmore Oral 
Reading Teste, Cnltfornta Journal of Educational Research , 16 , 
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Differential Content Validity; ihe California Spelling Test, 

An II lust la Live Example, Educational and Psy chologl cal 
Iteftsuremon *. , 25 , ^13- '*19 , 196 5. 

(k;neral Achievement Test, review in Buros, 0. K. (Ed.), The 

Six th Mental Me ssurenen ts Yearbook . Highland Park, New Jersey: 
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Gates Advanced Primary Reading Test, review In brros , c, K, (Ed.j, 

Ihe Sixth ^Jental Moasurements Yearbook . Highland Park, New 
Jersey: Gryphon I’rcss, pp. 1U58-1060, 1965, 
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re vie.' in Lducat 1 one I and Psychol cgl C a 1 I'e a s urcrc nt , 23, 
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Journal , 207-213, November, 1963. 

Mental Measurement of the Blind,* Ihe Vali(11ty of the Werhaler 
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education of the Blind, 65- 73^ 1906. 

Academic Ability lest, review in Jo urna l of Uduca t lonal Measurement 
3, 81-83, 1966 (with Ih C. Sander). 

Standards for educational and Pj; y chologi cal lusts aid Manuals, 
review In hducati ona l and i^syrjaologl eal Measurerryn t , 2b , 

758-759 , 1966 . 

A Practical I nt roduc ti cn to Mea.suveinent and Uvaluation (2nd ed.) 
by H, H. Remmers, N. L. Cage, and J. P. Kummeli, review in 
Kducatlonal and Psychological Meas ure ment , ^6, 10d3-xOdl, 1966 
(wi th vT. a7 Scase) , 

Auxiotv, IMw.iio logical ly and PnvcholorLca] Iv Measured, and Its 

Consequence on Mental lest Per forirerice (U.S, Of ficc of hducaticn 
Cooperative Kesearcii Prop.ran; rxo^oci ornber 3-10' 32^), tinal 
Report, 19f)6. 

TV vs. lenciier Ailndn I t rat ion nf Standarai /.ed Insts: Corparab 1 1 1 1 v 

of c r o s , J o u r ro^l of t ' < i u Cj i t i o; \ o_l Measurers; U , 3 , J 5 - 4 0 , 196 7. 

Metiiods of Predictinr, Crane One Reading Porforrance, 

Ciuidaiu e newsletter, j, 7"^'. i )01 » 



Corrparativc Aclii evenent with Depart rent a U zed and Self-contained 
Classroorr Organization, Ihe Arlt h rretl c leacher , 1 6 , 212-215, 
March, 196 7 (wltf) h. Trice and A. Prescott). 

In Constancy and Che fillnd Child, Internatic r^ < f Journal fo r 
^h^ education of the B lind , Jl_6 , 113-11^, Mo ^ , 196 7 (with 
L . McGul re) . 

Ihe Use of ”None-of - lliuse*' vcisus Horogeneous Alte natives on 
Multiple-Choice Jests: Kxperircnlal Reliability an i Validity 
Comparisons, Journal of Udn cacional Measuterent , 52-3H, 
Sumi-jer, 190 7 "(with M, VI 1 Hams on). 

Psychological Measurement and I'rodiction by P. Horst, review in 
Ps y ch one tri ka , J_2 , 353-35o, September, 196 7 (with K. A. Smith), 

A Sclierna for }’ roper Utilization of Multiple Comparisons in Research 
and A Case Study, Arv r 1 can K on c a 1 1 ona 1 r' ti s e a r c h J ourna l, 

6D7-612, November, 196? (witli h. A, Chadbourn;. 
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Comparative Validities of Essay and flbjective Teats, Research 
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Office of Education, bureau of Research, Washington, D.C,, 
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Ctates Advnnccci J^rimarv Reading Tents, reviev; in (scar R. Ruros (Kd.), 
Ucadis^ Grs^nLon Press, pp . 296-297, 196S. 

Five-Year Stability of Language and Non-Language IQs, Research 
Paper No, 23 , Laboratory of Educational Research, L'nlve’'! i ty 
of Colorado, January 1969 (with M, Blbclhcimer) , 

Ihe Experimental Unit in Stdtlstical Analysis, Kescai ch Paper ho, 28 , 
Laboratory of Educational Research, University of Colorado, 

^'arch 1969 (with P, 1), Peckham and C, V Glass), 

Predicting orade One KcafUng Perfornance: Intelligence vs. 

Reading Readiness Tests, Jour nal of Experimental Educaticn , 

22, 31-33, ..'^rlng 19o9 (witli E. G, Sitkel). 

i^roducc livaluation of hew Design for I/carning: A Junior High 
School Model, fear I, Laboratory of Educational Reseat cli. 
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Regression and the Matching Fallacy In Quasi-Exper Imontal I'esearch, 
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Ihe Experimental Unit in Statlstica? Ai.alysls, Journal of 

Special hducot io n (with P. D, Pcckhan and G, V Glass), 2i 337-3^*^, 1969, 
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Research Paper No, 3 5, 1,'ibora l ory of Educational Research, 

University of Colorado (with A, T, Uakstian anC d, R, kopklns) , 19 70, 



6 



^ijnno til 



i’uU'i i cat ions (cont*) : 

utUicat ional artil 1^'^vcji ol or_i ra^ !U\j.s u rcjiioji t I ’,val n ation , i<n^1 c'?of)d 
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(In press). 
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ion Vear StabiHtv of Vi.“ri)al an! !,on-\'c rl>a] lonts, 
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levlew In ibsyd ionic t rika , 1070 (t^^ltli J, Collins) (in press), 

'Ibe (!opimuiial j tv oi !!ssay and nb j (Oive 'tests of Academic Acbic vewn t , 
Kdii cat l OJ 1 aj^ ai oJ rsycli olo )u on 1 M oas urerr>cn t , 10 70 (with G, Orach t ) , 

Jl. 359- 36 ^,"1970. " ' 

Aciiievenjc^nt in bcpartnental i zed and S<! 1 f-con t a i nod Classroom Orrar i j^a t i on , 
in Ashlock, K, d. and liermnn, W, 1., (Kds,), Cjrrent Research in 

Klomentary Scliool Mathematics, 'tacmi 1 Ian , 1970 (with C, Price and 
A. Prescott), 



AnxicLv, Physiological Iv and Psvcb.ologically Measured; Its Fffects on 
Mental Test Performance, P sychol o gy in the Schools , 1971 (in press), 

Five Year btability of IHs from l.angauge and Non-banguagc Group Tests 
(with M, liibelhetmcr; Oijld )>e velopno n t , 1971 (in press). 
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BLAINE R. ’^GRTHEN 



PRESENT P OSITION 

Assistant Professor of Educational Psychology, and Co-director, Labo^^atory 
of Educational Researcn, School of Education, University of Colorado 

PERSONA L DATA; 

Birthdate: 

Ho^ne Address and Telephone: 



Office Address and Telephone: 

70A B, Denver Center 
University of Colorado 
14th a )d A'^spahoe 
Depver, Colorado 
303-?44-6081 Ext. 360 

EDUCATIONAL ^A: 

B. S, -- University of Utah -- 1960 
M. S. -- University of Utah -- 1965 

Thesis: “Discovery vs. Expository ClassrooMi Instruction: An 

Investigation of 'reaching Mathematics in the Elementary 
School." Unpublished master's thesis. University of 
Utah, 1965. 

Ph. D. -- The Ohio St<te University -- 1968 

Dissertation: "Trio Impact oT Research Assi stantship Experience 

on the Subsequent Car'eer Development of Ed'jca- 
ticnal Researchers." Unpublished doctoral 
dissertation. The Ohio State University, 1968. 



October 10, 1936 

2805 Regis Drive 
Boulder, Colorado 80303 
303-444-3575 



Laboratory of Educational Research 
106 Business Annex 
University of Colorado 
Boul der', Colorado 80302 
:C3-443-2211 Ext. 8339 
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HONORS RECEIVED : 

1. University of Utah Normal Scholarship, 195i)-60. 

2. Received B. S. with "High Honors*' — elected to Phi Kappa Phi 
Honor Society, 1960. 

3. Granted a ‘'Doctoral Internship Education'^ {national fellowship 
competition) at The Ohio State University, 1965-67. 

4. Chosen as "Staff Associate" (national fellowship competition), 

University of Cnicago, 1965. Declined, in order to accept offer 
at The Ohio State University, 

5. Selected as the 1968 Ohio State University rlosher fellow (Annual 
award to outstanding male graduate student in education at The 
Ohio State University), 1968. 

PROFESSIONAL P OSITIONS 

1. Elementary school teacher, iS60-G2. 

2. Instructor, University of Utah Campus School, l^o2-64. 

3. Lecturer In education, College of Southern Utah, summer, 1964. 

4. Instructor, College of Education, University of Utah, 1964-65 (half tiwe). 

5. Research Assistant, Department cf Educational Psychology, University 
of Utah, 1964-65 Uialf time). 

6. Doctoral Intern in Education, School of Education, The Ohio State 
University, 1965- 

7. Research Associate, College of Education, "ihe Ohio State University, 

1967- 68. 

8. Associate Director, Lvaluation Center, The Ohio State University, 

19C7‘69. 

9. Assistant P’^ofessor, College of Educaticr», The Ohio State University, 

1968- 69. 

10. Assistant Professor, School of Education, University of Colorado, 

1969 - present. 

11. Co-director, Laboratory of Educacional Research, University of 
Colorado, 1969 - present. 
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CONTRACTS GRANTS REC EIVEU AND DIRECTED : 

Completed : 

Director* National Evaluation Leadership Project, 1967-68. 
(Funding received with D, L. Stuffleh j ESEA Title III, 
$48,000 (12 n/onths). 

Director, Strategies for Educational Change: A Dissemination 

Project, 1967-68. The Ohio State University Development 
Fund, $8,000 (12 rronths). 

Director, 0. S. U. — Xenia Eval';ation Project, 1968-69. 

(Funding received vn’th D. l. Stufflebeam) ESEA Title III, 
$27,110 (12 rrwnths). 

Cu rren tly Under way: 

Director, National Study of Research Apprert'ceship Experiences, 
1968-70. Phi Delta Kappa International , $11,890 (18 months). 

Director, AERA Study of Requirements and Procedures (or Training 
Researchers and Research-Related Personnel, 1969-70. USOE 
Research Training Branch, $67,673 (18 months). 

ACADEMIC TEACHIN G EXPERIENCE: 

Workshop In Teaching Mathematics (College of Southern Utah - Summer, 
1964). 



Elementary Mathematics Sections: Elementary Education Practicum 

(University of Utah - Summer, 1964). 

Workshop: Methods, Materials and ProcesSL> in Arithmetic (University 

of Utah - Autumn, 1964 - Winter, 1965). 

E-aluatiori Functions and Methodology in Education (The Ohio State 
University - Spring, 1968, teamed with D, Stufflebeam) . 

Seminar in Educational Research (The Ohio State University - Winter, 
Summer, 1969). 

Research Processes: Practicum in Educational Research (The Ohio State 

University - Winter, 1969, teamed with R. Bargar). 

Experimental Design In Education (The Ohio State University - Winter, 
1969, teamed with R, Hammond). 

Elementary Statistical Methods (University of Colorado - Fall, 1969). 

Evaluation Models and Procedures (University of Colorado - Fall, 1970). 

Methods of Educational Research (University of Colorado - Spring, 1970), 

Educatio?ial Research Internship {Sii;'erviso>'; , 

- Autumn, 1970). 



{Ur.iycTjIty of Colorado 
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OTHER PROFESSIONAL EX PERIENCE : 

1, Participant in National Science Foundation Suniner Institute in 
Mathematics, University of U^’ah, June-August, 1963. 

2 , Coriieree with University cf Illinois Committee on School Mathematics 
(UICSM), January 13-18, 1964. 

3, Discussant, Utah Council cf Teachers of Mathematics, Modern 
Mathematics Conference for Pre-service Elementary Teachers, 

Febi’uary 15, 1964 

4, Guest Instructor (with S, M. Jencks), in video-taping a series of 
instructional TV prograrfis, including discussions and classroom 
demonstrations in modern riiatherr.atics instrucuicn. University cf 
Utah Audio-Visual Aid Department, 196^-65. 

6. Editor, St rategies for Edi/cationil Change (^EC/ Newsletter , The 
Ohio State University, * 

6. Participant in Training Program in the Use of Manager.;^r Information 
Systems in Educational Research and Developinont Activities, The Ohio 
State University, December, 1966. 

7. Guest Editor, Theory Int o Practice, June, 1967. 

8. Consultant, ESEA Title III directors. State of Indiana (on evaluation), 
November 14, 1967. 

9. Consultant, Saginaw City School System, Saginaw, Michigan (on evalua- 
tion design and process for regional supplementary service center. 

Title III, ESEA), October, 1967 - ^pril, 1968. 

10. Consultant, Kanawha County Schools, Charleston, West Virginia (on 
evaluation design and instrumentation for exemplary space-related 
science project. Title III, ESEA), December, 1967 - May, 1968. 

11. Consultant, Mid -Continent Regional Educational Laboratory (on 
evaluation and research design), February 19-21, 1968. 

12. Organizer and Senior Institute Instructor, National Science Teachers 
Association Institute on Evaluation for Science Program, Washington, 
O.C., March 24-27, 1968. 

13. Lecturer, Latin American Institute, The Ohio State University (on 
measurement techniques), April, 1968. 

14. Consultant, Educational Planning Mission to Ecuador, Agency for 
International Oevelopnient (on designing a study to assess institu- 
tional capacity to implement educational plans). May 13-15, 1968. 
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OTHER PROFESSIONA L EXP ERIENCE \CONTINUED): 

15. Selected as participant in Second Annual Symposium, National Society 
of Professors of Educational Research, University of Colorado (focus 
on development of Instructional materials in R, D, and D). November 
19-21, 1968. 

16. Consultant, Appalachian Regional Laboratory (on conceptualizing an 
information system for process evaluation), December 13, 1968. 

17. Consultant, Xenia City Schools, Xenia, Ohio (on developing a Title 
III, ESEA proposal), December, 19G8 - January, 1969. 

18. Lecturer, Defense Management Center, Wright-Patterson AFB, Ohio 
(series of lectures on measurement and evaluation), January - 
April, 1969. 

19. Organizer, Symposium: An Analysis and Syrsthesis of Recently Completed 

Empirical Studies Related to Training Educational Research, Develop- 
ment, and Dissemination Personnel, The American Educational Resea'^ch 
Association Annual Meeting, February 7, 1969. 

20. Selected as discussant in Tenth Annual Phi Delta K.appa Symposium on 
Educational Research, Salt Lake City, Utah, April 10-12, 1969. 

21. Organizer and Instructor, Institute on Evaluation, Elk Grove Training 
and Development Center, Illinois, March 3-6, 1969. 

22. Selected as participant in AERA post-session on experimental design, 
College Park, Maryland, March 28 - April 1, 1969. 

23. Consultant, Bartholomew Consolidated School District, Columbus, 

Indiana (on developing an evaluation design and monitoring system), 
June 19-20, 1969. 

24. Lecturer, Illinois Program for the Gifted Summer Institute on 
Evaluation of Learning, July 28-30, 1969. 

25. Lecturer, EPOA National Institutes on Evaluation, Columbus, Ohio 
(lectures on measurement techniques and use of simulation in train- 
ing evaluators), July 7-11, 1969 and August 11-15, 106J. 

26. 1969-70 Program Chairr^ian, AERA Special Interest Group: Professors 

of Educational Research, July 1, 1969 - July 1, 1970. 

27. Appointed as Advisory Editor for tne J^uj*jia_]_ of Educational Measur e- 
ment , September 20, 1969 - present. 



28. Conducted an evaluation of the ESEA Title IV Graduate Research Training 
Program, Laboratory of Educational Research, University of Coloraao, 
September 15 - October 31, 1969, 
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OTHER PR OFESSIONAL EXPERIEN CE (CONTINUED) : 

29. Consultant, Colorado State Department of Education EPDA programs 
in Special Education (on developing a design for formative and 
summative evaluation), October 22, November 25, and December 16, 

1969. 

30. Served (with Gene V Glass) as advisor to the Colorado State 
Department of Education, Division of Research and Development 

(on developing and testing a state assessment system), November 1 - 
present, 

31. Lecturer, Graduate Seminar on E'^aluation, The Ohio State University, 
Columl)us, Ohio (lecture on evaluatioii and research designs), 

November 17, 1969, 

32. Consultant, Colorado State Department of Education, Division of 
Research and Development (on developing an information collection 
and management system in response tc mai^ciate of House Bill 1129), 
November 4 and December 15, 1969. 

33. Organized and coiiducted a Regional USOE Meeting on ihe Future of 
Title IV Graduate Research Training Programs, Boulder, Colorado, 
December 3, 1969. 

34. Director, Institute on Writing Research Proposals, New York State 
Consortium on Research and Development, Buffalo, New Yorr. , December 
5-6, 1969. 

35. Selected as a member of a team to conduct a site visit and evaluation 
of the Oklahoma-Texas TIT Project, Durant, Oklahoma, December 21-22, 
1969. 

36. Appointed as Field Reader for the USOE Research Training Branch, 
January 2, 1970 - September 30, 1971. 

37. Gave an address at the Colorado School of Mines professional 
development colloquium. Golden, Colorado (on classroom testing as 
an aid to improving instruction), January 15, 1970. 

38. Conducted an Institute on Writing Object i ve-referenced Tests for 
the Colorado Department of Education Task Force on Assessment and 
Evaluation, January 29-31, 1970. 

39. Evaluator, Measurement and Evaluation Center in Reading Education, 
Indiana University (asked to evaluate tr.e utility of a training 
package designed to train evaluators of reading programs), February 
27, 1970. 

40. Organizer and Ciai^maan, Symposium: The Research Assistantsnip as 

a fonnal Coiuponent of Programs for Training Eoucational Researchers. 
The AiiX?rican Educational Ro'^earch Association Annual fleeting, 

March 5, 1970. 
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OTHER PROFE SSIONS ' . EXPERI ENCE ( CON T I N UE 0 ) : 

41. Appointed as Chairman, AERA Task ^ "ce on Training Research and 
Research-related Personnel in Education, March 6, 1970 - present. 

42. Evaluator, EPDA Teacher Preparation Program, Southeastern State 
College, Oklahoma, May 14-15, 1970. 

43. Served as advisory referee for Revi e^w of Edu cati onal R esearch , 1970. 

44. Selected as Test Reviewer for the S eventh Mental Measur emerrt 
Year book , May, 1970. 

45. Panelist, USOE National Center for Educational Research and Develop- 
ment, Research Training Branch review panel of proposals for 
materials development grants, Washington, D.L, June 15-16, 1970. 

46. Evaluator, Eleventh Annual Phi Delta Kappa (International) Symposium 
on Research, Columbus, Ohio (charged with conducting an evaluation 
of tfie symposium and writing the report as a chapter for the PDK 
Eleventh Annual Yearbook), June 22-23, 1970. 

47. Chairman, LfSOE Meeting of Directors of Graduate Trai. .ng Programs, 
Washirigton, D.C. July 7, 1970. 

48. Commissioned to prepare one of three conceptual frameworks to be 
presented at a USOE/Oregon State System of Higher Education "Review 
and Refinement Conference on Conceptual Frameworks for Educational 
Research and Related Activities," Lincoln City, Oregon, July 20-22, 
1970. (paper prepared with Gene V Glass) 

49. Selected to Advisory Committee on Evaluation Training, Center for 
the Study of Evaluation, UCLA, 1970 - present. 

OTH^ RELEVA NT EXPERIENCE: 

1 . Served as missionary for Church of Jesus Christ of Latter Day 
Saints in Australia, 1955-58. 

2, Personnel Manager, Continental Iambic Corporation (second position 

30 hours weekly), 1960-62. 

3. Stake (regional) Teacher Training Director, Church of Jesus Cnrist 

of Latter Day Saints: Mt, Jordan Stake (Utan), 1962-65, Columbus 

Stake (Ohio) , 1963-69) . 
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(■MEMBERS HIP 

1 . 

2 . 

3. 

4. 



M P rofe ssional ^s_^ocij\n&{s : 

Local, State, and National Education Association, 1960-6'^. 

Phi Delta Kappa, 1964 - present. 

Ar^erican Educational Rosearcl Association, 1965 - present. 
Association for Supervision and Curriculum ic ament, 1956-69. 
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MEMBERS HIP IN PROFE$$IONA‘ ASSOCI ATIOiMS ; 

5. National Society of Professors of Educational Research, 1968 
present. 

6. AERA Special Interest Group: Professors of Educational Research, 

1969 - present. 

7. American Psychological Association, 1969 - present. 

8. National Council of Measurement in Education, 1969 - present. 

P ROFESSIONA L WRITINGS: 



t. Qnograp hs 

Clark, D. L. & Worthen, B. R. (Eds.) Preparin_g ^^?sea/ch \ ers onnel for 
yuca^_on. Bloomington, Indiana: Pi«i Delta KappV, V9G7. 

Worthen, 3. R, .S Blanke, V. E. (Eds.) Straten j 

New London, Connecticut: Crofts Puhlisnerc/ Inc. (in pVess) 



Chapter s in B ooks hjld_ j:ion_ov|r aj^hs 

Bravnell, S, M. & Worthen, 3. R. ".New Roles for Public Schools in 

Training Educational Researchers ," in Clark, D. L. & Worthen, B. R. 
(Eds.) P repari ng Research Personnel for Eciycajtij^, Bloomi noton, 
Indianaf Phi Del ta Kappa." ^9677 

Worthen, B, R. "A Comparison of Discovery and Expository Sequencing 
in Elementary Mathematics Instruction," 'In Scandura, J. M. (Ed.) 
Research iji_ Math omati c s c_a_tj_p n . a t i o n a 1 Council of Teachers 

of Mathematics. 1967. 

Worthen, B. R., Sanders, J, R. & Rogers, W. T. "Evaluation and Meta- 
evaluation of the Eleventh Annual Pfii Delta Kappa ResearcEi Syiiipo- 
sium" L]^enUi_ Annu_^l Phi Delta Yeisrbook, Chicago, Illinois: 

Rand McNally. 1970. ‘ 



Te_x t u a J_ j 'laj^e r i ^1 s 

Worthen, B, R. S Hock, M. D, A,p}^roactJ to Trai^in^ 

Columbus, Ohio: Hadoworth PunlTshcrs", iV.c. (in'p^c-ssl 

Hock, M. 0. & Worthen, 3. R. A iijiuJaJLioji Ap^rca^ch to Traiinnjj Prq5.r^- 
Coluni)us. Ohio: l<adsy-,orth PubiTshe'rs'/T7cV (i:i prc77i 




Articles Pub lished Jn_ PXQ.Cessipnal_ Po) i_od^^ 

Worthen, B, R, "The Innovation Dilerina," foj Educiti ora ■ 

C hange (^£) News letter, Voiuf>: 1, i;'r,oer TS*. "Tfovember 1966. 

Hopkins, J. C. & Worthen, B, R. "Change :* S'^rools, ' 

for BdjJCdtjonal Change (SEC) Newsjottr^'. 7 1. I, .No, 12, May 1967. 
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PR OFESS IONAL [Continued) 

Worthen, B. R. “The evolution of Title III: A Study iri Change," 

Theory Into Practice , Volur.iG 5, Number 3. June 1967, 

(Also reprinted as: “A Change in Title III?" 

Str a te qies f or Education al C han ge ( SEC ) N ewslette r, 

Volume II, Number 2. November 19b7. 

Worthen, B. R. "Discovery and Expository Task Presentation in 
E 1 ementa ry Ma thematl cs , " Journa'? of Psychology . 

Mon ogra ph Supple ment, Volume C'9, Number 1, Part 2, February 1968. 

Worthen, B. k. “A Study of Discovery and Expository Presentation; 
Implications for Teaching," Journal of jeaejer Educatj^n. 

Volume 19, Nuirrber 2. Surr^mer, 1968. 

Worthen, 8. R. "Toward a laxoTior.y of EvaKation Designs," Educ ational 
Technology . Volume 8, Nuf.r.cr 15 August 15, 1968. 

Worthen, B. R, & Roaden, A, L. 'A Profile of f\ERf Meinbers as Resect :^ers , 
Educatipnal Researdter, Vcjiume 21, October 1970. 

Worthen, B. R. "The Researcfi Assistants!' i p: A Look at the Folklore ' 

(abstract), R esearch in Ecucatron, Junuary 1970. 



Worthen, B. R. & RoadC'r, Arliss L. "An Analysis of the Research 

Involvement and Productivity of AEPA Members," Jour nal of Edu cat ional 
Re searc h (in press). 

Worthen, B. R. & Collins, J. R. "Reanalysis cf Data from Worthen's 
Study of Sequencing in Task Presentation," J^P^TL^J. E ducatio nal 
Psyc hology (in press). 

Worthen, B. R. & Clark, P. M. 'Toward an Improved Measure of Refr.ote 

Associational Ability," Journal of Educa tiorfdl Measurement (in press) 



Repo rts o 9 h__a|i d _Ey a luat i o i ^ S t u d i_e s 

Oella-Piana, G. M., Eldredge, G., & Worthen, 3. K, E.v .ri'^ents^ i_n_ 
D iscovery ,E[ij^r^cU\r;s i ; . s' oY T^x't 

M aterials and Transfer q_f_ Learning. Salt Lake City: Bureau of 

Educational Research, University of Utah, 1965. (Part I of f nal 
report of USOE CRP Project 2277 ). 

Worthen, B. R., Eldredge, G. , and Della-Piano. G. M. ^ru )tsjs: 

CliaractejisUcs of Text Materia iV and Transfer 
o n.eai ^n1hg. SaTt'TaYe City: T^urxlin orF/oucVti’orTal'Rese^^^^ 
University of Utah, 1965. (Part 2 of final ropoit of USOE CPP 
Project 2277). 
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P ROFESSIONAL WRITI NGS; ( Conti rued) 

Worthen, B, R, '‘A Re-analysis of Morfnative Data from the National 
Register of Education a l R e $c-archers : Implications for Research 

Training,^' in Clark, D. L, and Hopkins, d. E., A Stud y of Roles 
for Researchers in Educa tion , Bloomington, Indiana: School of 
Education, Indiana University, 1968. (Final Report of USOE CRP 
Project X-0^2). 

rtorthen, 8. R. & Rcaden, A. L. The Impact of Research Assist antship 
Columuus, Ohio: Evaluation Center, The Ohio State 

University, 1963. (Final Repo*'t of Phase One of special PDK Study. 

Worthen, b. R., iCean, M. if, and '1cL augh 1 i n , Nancy. E_va_] u_at i_cr^ _ojf_a 

• Columbus, 

Ohio; Evaluation Center. 1969 fFinal evaluation repo^^t on third year 
of Xenia City Schools Title III). 



Worthen, R, R. & Sanders, J. R. 1* ' ^ 

Tjpaining Prjigraji], Laboratory of Educa ti unal ’h;sea»'Cd: T968'5’C. 

Boulder, Colorado: Laboratcry of Educat ional Research 19Ch 

(third ani:ual progress and evaluation reoort). 

Wortnen, B. R. & Roaden, A. 1,. Relationships B etwee n Research Produc- 
tivity and Sji_e_cj_fj_c ^_te cedent Experiences as a Researen Assijlcf 
Columbus, Oliio: follege of Education, Onio State J. , f97h"TFinX. 

report of Phase T.,o of special PCK study). 



Test Authors hi ps 

Wortlien, B. R. & Stufflebeam, 0. L. Tne Ohjq State Urvi\;ersi_^ Rcsourf 
Competence Test, Columbus, Ohio; Test Devulopment Cantor, tTT 
Ohio State University, 1968. 

Worthen, B. R. & Clark. P. IE fnnction^iljx RorfOte Associates Tesjt. 

Columbus, Ohio: Test CE'Vel opn^ent Center, "The Ohio State Unive's"’ 
1969. 



f^aperj: Rejd 

Wortnen, B. R. "Soiie Notions Abt.ut a faxonomy of Evaluatiu. Oesinri^. 
Presented at the Ajoevican Educational Research Asscciction ar/ninl 
meeting, Cnicago, Februa»^y 8, 19vS8. 

Wortnen, B. R. "A Study of Research Appren Li ^csiii ps : Iiiipl 1 cat i cii - 

for Training Educational ResearCfiers /' Prosentea oC r.'r Au:eric 
Educational Rescaren Assuci itioi. annual meeting, Los /cigcle. , 
February l9C9. 







PROFESSIONAL W RITINGS (Conti n:Jtd) 



Worthen, B. R. "The Relationsnip of Research Assistantsnips to Subsequent 
Career Development in Educational Research." Presented at the 
American Educational Research Association annuel meeting, Minneapolis^ 
March 5, 1970. 

Glass* G. V & Worthen, B. R. "I nterrelationships Among Research and 
Research-rel ated Roles in Education: A Conceptual rramewor’<." 

Presented at a USOE/Oregon State System of Higher Education conference, 
Lincoln Beach, Oregon, July, 1970. 



O ccasiona l Papers /Techtiical 

Worthen, 8. R. Bur^aucrati c structures und educational change. Columbus, 
Ohio: The Ohio State University, School of Education, (mimeo): 1966. 

Worthen, B. R. "Development of a Functionally Rcrrute Associates Test 
(FRAT}." Columbus, Ohio: School of Education, The Ohio Strie 

University, 1967. (mimeo, 31 ppj- 

Hock, M. D. & Worthen. B. R. ''Sin;Ul ati on in Program Evaljation: 

Methods and Materials for Training Personnel." Columbus, Ohio: 
Evaluation Center, The O^iio State Univei-sity , 1968. (rrimeo, 62 pp-}. 

Worthen, B. R. Hock, M. u. "A Simulated Evaluation Design Problem: 

Basis for a Training Institute in Evaluation." Columbus, Ohio: 
Evaluation Center, Tne Onio State University, 1969. (mimeo, 80 pp.). 

Wo. then, B. R. , & Gagne, R. M. "The Development of a Classificaticn 
System for Functions and Skills Required of Research and r;ei>earca~ 
related Personnel in Education" Tech nica l Pa p er No. 1, AERA Task 
Force on Research Training, Decenfber 1969. 

Worthen, B. R. , & Clark, P. M. "Toward an Improved Measure of Renr:ote 
Associational Ability," Research Paper No. _38, Laboratory of 
Educational Research, University of Colo)’ado, December 1969. 

Wortiien, B. R. & Roaden, A. L. "Are Members of the A^urican Educaticnal 
Research Association Researcher's?" Res earc h Pap^r f^q. 39, Labora- 
tory of Educational Research, University of Colorado, Oo'cernber 1969. 

Worthen, B. R. , "The Relationship of Research Assistantsuips to Subsequent 
Career Development in Educational Research" Resea^rdi P_a|)o_r No_. 
Laboratory of Educational Research, Uni vcm si ty of C'olc'rcdOj March 
1970. 



Wortnen, G, R. Sanders, J. R. "Tn? Owe lopnrnt o1 tir, Int^rTvie.-. 

Teennique to Collect Data on Jr.iportance iirJ Avai labHity of Selected 
Competencies in Research, Development, Diffusion, and tvaiuaticn" 
Tec hnic al Paper No. 2, AERA Task Force on Resear'-h Trainirid, Maicn 
T9‘70. 
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FMi ^AlQMk M JJi’ G?. (Continued) 

Sanders, J. R. & Worthen, li>. R. "An Analysis of Employers' Perceptions 
of the Relative Importance of Selected Research and Researcn- 
related Competencies an1 Shortages of Personnel with Such Compe- 
tencies" Techni ca l Repo rt . 3, AERA Task Force on Research 
Training, June 1970. 

Glass, G. V & Worthen, B. R. "I nterrel ati onshi ps Among Research and 
Research-related Roles in Education; A Conceptual Framework" 
Technical Pape r No. 4, AERA Task Force on Research Training, 

June 1970, 

Worthen, E. R. ^ Sanders, J. R. "An Analysis of 1968 AERA Employment 

Service Data; Competencies Possessed by Applicants and Competencies 
Required for Positions Listed" Tec hnic al^ Rep ort flo. AERA Task 
Force on Researcri Training, June 1970. 

01defendt,S. J. & Worthen, Lm R. "An Analysis cf 1969 AEPJ\ Ej^ipioyment 
Service Data: Geographic Distribi *:ion of Positions and Appli-^^nts 

and Other Denjographic Data" Technical Paper 7, Force 

on Research Training, June 1970, 

Rogers, W. T. , Worthen, B. R. & Sanders, J. R. "An Analysis of 1970 
AERA Employment Service Data; A Comparison of Applicants' Per- 
ceptions of Their Co:npetencios in Research, Development, Diffusion, 
and Evaluation, with Such Competencies Required for Positions 
Listed" Techni ca l Pape r No. 8, AERA Task Force cn Research Training, 
June 1970. 

Worthen, B. R. & Popham, W. J. "Researcfi “^raining Activities Stimulated 
by the AERA Task Force on Research Training, 1969-70" T^hnical^ 

Paper Wo. 12, AERA Task Force on Research Training, July T970. 

Worthen, 8. R. & Collins, J. R. "Reanalyses and Rei nterpretation of 
Task Presentation Da : A Postscript co a Previous Study" 

Rese arch Paper jU, Laboratory of Educational Research, Univer- 
sity of Colorado, August 1970. 

Glass, G. V & Worelien, B. R. "Essential Knowledge and Skills for 
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Progress Report and Evaluation of the Graduate Research 
Training Program and the Laboratory of Educational Research* 



History 

The Laboratory of Educational Research (LER) is the training vehicle for a 
graduate Research Training Program at the University of Colorado. It was 
established in September 1966 through two grants from the U.S. Office of 
Education under provisions of Title IV (Educational Research and Training) 
of the Elementary and Secondary Education Act of 1965 (P.L. 89-10) . The 
grants totaling $62,420 for the first year (1966-67), [ ] for the second 
year (1967-68), and $61,240 for the third year (1968-69) permitted three 
necessarily interrelated moves: (1) strengthening the staff via funding 

of one full-time faculty position in research methodology, (2) increasing 
of curricular capability and training facilities needed [ ] preparing re- 
search specialists ir education, and (3) providing support for eight 
Fellows (^'Fellow" and "trainee'* will be used interchangeably) pursuing the 
Ph.D. degree with specializaiion in either research methodology or a 
highly research-oriented program in a substantive area in education. The 
support for the strengthening of faculty and facilities resulted in the 
establishment of the Laboratory of Educational Research in September [ ], 

directed by Kenneth D. Hopkins, and in the addition of Gene V. Glass to the 
faculty of the School of Education as Co-Director of the LER and assistant 
professor of educational psychology in June, 1967. In August [ ] 1969, Blaine 
R. Worthen was added to the faculty as an assistant 

*Retyped by Clearinghouse from poor copy. Omissions denoted by brackets-. 
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professor of c Jueat tor a 1 (jsycholopy and to-Di rector of the l£R, 

rhc Untvo'^iry of (blor«Tdo orl^Jnallv allocated 1,000 8<^uare feet 
for I he laboratory vhlcb !ia;< since been expended to square feet* 

llie U.H contains: (a) a Pl -cst library (numbering about 1,175 volumes) 

of relevant professional periodicals and reference books, (b) a statistics 
lafjoratory equipped vtth six automatic calculrtlnp rncliincs , (c) t^vo 
far\ilty ufflcoa and n secretarial area, (d) a desk anu fl linp cabinet 
for cacii trainee, (e) a rental keypunch and 3M Copier, and (f) a 
sominar-'ConsuHatf on area, 

A continuation prant of for 1969* 70 was .warded for the 

nurposi* of rmlntaininr the iraininp function of LL!f ,nt i tn current level, 
vl/. support for eipUt full-tine fellowships. 

In adcUtl<M to the oiqUt tSKA KellcrJs, rv^nborshlr* in IJ;R is onen to 
jny <^oa<Iuatc ?;tudcat in education who meets the criteria for resefreU 
notontiaJ a*- e^.tabllshad in he original nroposnl; < i) an undergraduate 
CPA of il least 3.0, {2) a composite Ci adult c Iccoro Lxamlnntion (V f. n) 
score of (tne upper ten per cent of collcpie rr&du\tes in all fiel<ls); 

tli 1 .1 cticorion has been raised to 1250 for iihj-yo, and (3) interest in 
' ■ '-lour In whicii e<lucavlonal research is hip,Ulv relevant. 31\rce eraduate. 
siod.uai*' elocicd ro be a ]>art of U'P i or the 19ft7-6d fu'riod; 

iUrf'o wen iu V>c tiiiniur proprar. for I9(»tl-c0; am" two NfiL7 

Kenow’s ulecit'd to lie part of the L^V tiurinp iObO-VO, In ijdeltlcn, one 
Tosc-arch. ,’issi slant suppo led by Univeriity of Colorado funds also elected 
to oart ' ci p.it e ae an IJvK Feller.? durlnp 106?- 



00 



IT. Financlnl ^ Traininr, Fuop'ram) 



196ii-69 



19C?9-70 





Awarded® 

in 

grant 


Eypendi turen 
du ring 

grant period 


Awarded 

In 

grant 


V rospect Ivc 
lixpendl tures 


a. Student Sup}‘ort 


‘it Lpends 


$ 21,400 


$21,600 


$21,600 


$ 21,600 


bepcncienCs 


14,^00 


n ,650 


10,000 


10,000 


1 rave 1 


cOO 


260 


000 


170 


b, Institutional 


A1 Iowan C'3 


, i 0,(!00 


20 ,000 


20 ,000 


20,000 


c. I’nt n 1 


$ 56,200 


$ 55,290 


$52 ,600 


$ 51 ,9 70 



a 

'-•I'ant pfcriods 6-I-Otl to o- 3 1-^69 to include $2,200 undlrect in^-ir d dependency 
allov^'ancc for 9-1-67 - ci-3i-68 



III. £JL' J ® 0 1 1 vcfl 

'iUe objectives of the training, program of the U‘P v.-ere stated in 
tho original piopoaal which requested funds to estabil'^:h the laboratory* 
Ih.' najor objective of the l£R ;^nd three inst rurent ij c ujectlves r.ecessar>' 
to achl^V(J the major objective was listed as follov^s: 



>. To attract, train, and graduate portions vlth cornctcncc in, 
and dediertioa to, clucaLicnal research taat will enable Cher, 
to stinuiatc ntid conduct loscardi studies focjstd or, Irprrtanu 
aspects of e lucritlon. 

.1, To develop and Gcrcnpthen the speciali^.cd i^taffs In statistics, 
p'ehsurerenL , research design, and ccrpul\-r applicatic 

2. To develop rhe curriculai capability in order that the necel^sary 
and piolessiopcJ experience for speclall?: atl cn in educational 
research Is piovlded* 

*. To nrovide the neressaty relevant rattr»als and equinr>ent 
required for a corprohenslve training program in cducatioml 
resr arc!; , 
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Tlio cvflltKinion rtij^orts for 1966-6 7 ant) 1967-68 ahof-j clearly that 
tfieac objectives iinve been attainecJ, However p as the IXR training propram 
[iiM, evolved, n^any addltlenal implicit objectives have become apparent. 

In an atteir;^t to explicate these objectives, the LE)'. directors developed 
a comp rci’ endive ^>et of objectives lor the reaction of L£K fellows and 
staff, V.ic quRS ti onnoi re which was used to did*' Information on acceptance 
of the objectives appears below alonp, with the results of its admlnlst ration, 
Althoupli th« f Cl ponses were analyzed separately for U:f< faculty and Fellows 
by year of entrance into cite proyram, the reaction? did not differ 
s Lpni tc:m t ly across preups; tlic.reforc, the rcRulCs w re added and are 
reported as totals l>elow, 

.JULSnONNAIKJi ON U;R OBJfaiVHS 



Ho recent exp It c l I statanicnt of the objectives of LLR is presently 
rn record, fcevloun evaiuntions of the IZR have made reference to the 
"ohjectlvea of the ^^raduate Kescavch Training rro^^ram,” aurpestlnm the 
cx 1st once of a sot of i objectives, Belcrw Is an attempt to 

explie^ito Ihoao objectives. The directors of Lf,P have expressed concern 
t.i.i^ M;(. . jcctlvcs should reflect the objectives of the Fcllov;?, 

'Vnuld yon therefore: respond :o each objective hv Ir.dlcntlnp \'ith a check 
novK In rui^ appropriate colu^in, the depree to which you orreo with It, 

Jn addition, if there are objectives \7nlch in your niud nave been omitted, 
won It? you p!:^£isc mid <:hen to this list, 

* d ■ t f t ato iHiJect 1 v t»s 
* • *' la cc J^f work 

Hroduco In cciucati On-il 

research v'm will, after oraduitlni, 

work : rjtronply S iron ply 

Ihifiklnp Arrea Din a p re o 

^ } 

l a) < ol lepes or unlvcr.ll t lo i 22 1 o 0 

f h) (wrricuUr ].’e vc lopron t »ro)^ct‘ 3 J .1 6 1 0 




6 



c) 



K.;uC‘*^t j 1 Divisions of }‘rJvate 
Tot [ pftn.tr s J v,p,, Xerox 

42 



1 r' 



3 



5 



1 



Ihmk \ 






St roar ly 
Aprec 
] 


I 


3 


4 


St ronrlv 
)>lsa> ree 

i' 

J 




d) 


la>n“lseat*orch 1 t'is 1 1 1 on la Stotc 
Dopt, ol Ihi’jcatlnu 


a 


0 


4 


<> 


10 


It) 


e) 


Non-Kcsear ch I'ouitlon in a 
Public hchool Syster 


0 


0 


2 


9 


12 


d 


O 


V ub 1 1 9 h in r 1 1 ou s cs 


f) 


7 


5 


7 


4 


1 


f?) 


Kepi ona] Laboratory 


10 


13 


0 


U 


0 


2 


it) 


Kc search an ri lx?vt lopriont Cciitor 


1^ 


8 


1 


0 


0 


'f 


i) 


I'o Search Olvlslor. of a Public 
School Syster^ 


7 


m 


4 


2 


0 


J 


j) 


Hesoarclk iJlvlslon of a State 
Oept, of Ldncatlon 


5 


13 


5 


0 


0 



^^^nk order - fron ”1” hiphest to **10” lowest, the above post-doctoral 
ncclvltles on the basis of your wa preferepcc. In the case of ”tlas” 



indicate so i>y ajsipnlny the sane rank, IMease piac'^ your rankinps In 
the spaces to the left of each position, 

0x1 rate Obj e c t ivG s 
I'rovidu the I'eJlcos witii the 

follcrvJnp i list fuct Lona 1 and professional 
op.* i'i : 



Vo ry 

I'sscntlo] 

1 



I 



a) Tnurfic '^'ork in stnlatlcfl, reaearcli 
rfthods, cv iluaLivm, dosipn, 
n*!asuroMent , .'*nJ corrinitov utilization 23 

hj ] n Lerdisclp Hnaiy course vorl: in 

.ittcnJant aroiis 11 



Of No 
Va lue 
3 



31 



c) i' loxi ill 11 ty , al Irvii\r' for individual 
specialization in a particular area 

uf educational rest*arcJ\ 13 

d) ‘hl'^ervlsed internship experiences on 
pr</jocts that involve botli basic ^nd 
applied educational research, that 
incUido experiences witii; 

( i ) pub He s ciifpols 3 

(11) slate depir treats cf cducaticn 
(Liil n^iticnal currtculun prci^ects 3 

(Iv) rcpional Ian oratories 1 

^ v'l rcscj'‘ch iK\.\ dcv\» lopT>^nl lai>s 7 



10 

n 

:o 

H 
T 3 



7 

h 

Id 




'i 5" 

43 



Verv 

lessen ti .'1 

1 2 



oi :<o 
V/! Itjo 



t‘) Supervised cousultation with clients 
( ro<ic archers , stiidanCs vorklnp on 
tholr o\/n research) on J 

(1) rcscardi deslj’n 21 2 0 

(Jl) selection of anprc'>rlate data 

analysis techulmjes 21 2 Q 

(lii) interpretation of data analyses 20 3 0 

( i v) r*sisurencnt ami instrunent 

lieve lov>r>cnL 17 !i 0 

(v) evalaation 16 6 1 

(vi) corrputor use 17 ^ 2 



0 0 

0 U 

0 0 

0 0 

0 0 



f) Supervised teach iup^ and otticr instruc- 
tional activities (e»y,, critique 
papers, conduct Inc help sessions) 
of courses in research netheds 
(Ijroadlv defined), 

c) lull ilea tl on of scholarly reviews 



n 

13 



0 0 



h) I’roductl on and publication of 

indlvltical and proup research projects 



20 



1 ) Attendance at fcctiucs of educational 
TfJsearcU assoc la cions 



1 ^ 



M . jVrLlvltics 






Produce Ph,lh^: In education res ear di Stronply 

A^^ree 

'ill, a i l » r p. r a d u n c t on ; 1 



r; c ronp ly 
Pisarree 
U j 



a) ieaclt resoar cli- i levant couisus at 
t!io ;^radunt<t level 



21 



0 ') 



i'.^'icfi J'esfi.nch- re i»^v*'ia t courses at 
the unde rpraduat o level 



3 3 



x ) h'.acU rioasu reri^Mit and evaluation 
cr>ursiT. at Che KraJuano level 



18 



0 0 



«i) Teach reasurcrent and evalu ition 
courses at the unde r ei cduate level 



11 



0 



o) Advise ) 1 astera and L'octoral students 

on rcsearcl^ 21 

i; dunduc t basic edur at tonal research 2 U 

(MduM orJucaMrnal resoaren T> 



0 0 

0 a 

0 1 } 



o 

ERIC 



'll 



U) 



i) 



j) 

k) 

l) 



n) 



n) 



o) 






'D 



r \ 





Strongly 

Agree 

1 




3 


4 


S t ron 
Disag 
5 


1‘evclop fundable research proposals 


15 


6 


2 


0 


0 


Consult v?it\i other faculty and/or 
educatlcm agencies on research 


16 


6 


1 


0 


0 


Fubllsh the products of their 
reiiearch 


22 


1 


0 


0 


0 


Assume an active role in educational 
research professional organizations 


12 


') 


1 


0 


0 


Continue their Ofvn train in r, tli rough 
cud^ activities as research training 
workships ^ post-doctoral years, 
continued course work at universities 


15 


8 


0 


0 


0 


Train new education researchers 
(graduate Vh.D.s - working as their 
major adviser) 


18 


5 


0 


0 


0 


Continue rosaarch contributions 
tUroucj.out thclc professional careers 


20 


3 


0 


0 


0 


iVisune a role in research administration 3 


a 


11 


0 


0 


Very 

Kssen cial 
1 


2 


3 




Of No 
Value 
5 


Participate actively at meetings of 
liduc itlonal researdi associations 
^Arcujis pvGsentatlon of papers, etc. 


12 


11 


0 


0 


0 


.riemlnars involving research sneclalista 
ritu «T 0 Soclaced with the lub 9 


u 


0 


0 


0 


yo»>tinj’, the raqul reTcnts for a Ph.IJ, 
degree, as opf osod to the r^d. D, degree 


12 


7 


J 


0 


1 



AcIUitlon.il dst^ on LEK Kel]oc;5* i>erceptioTiB of the cbjv!c:clves of 

the tohoratory were generated by four items In a qaestlonnairo administered 

to all fJvK Kellcws.^ items and rosponses to thein are shown belowi 

lltema from thin cjucs tionnalre (hereafter referred to as ?nnaire A) 

appear tlironphout this report In sections to which they are root relevant, 
A copy of the entire Instrument appears In Appendix A to this report. 




1 







St ronplv 

Aj.'. roe 
1 


2 


3 


k 


Stronp Iv 
Dl-saprce 
5 


1. Ilic nijject 1 vr;.s of the proy.ram 
clear to no. 


ve re 


7 


5 


0 


0 


0 


z', ifn* of)Jertlvos of the prop.ran 
not realist Ici 


we re 


a 


f) 


0 


6 


A 


1, Mm- participant-; accepted the 
of this nroprar. 


purposes 


3 




0 


0 


f| 


A* The cojcrtives of the prof^rarr' 
liu^ same as »ny r>l:jectivos 


^%»cre not 


0 




0 


b 


A 



o 

Tv/d I terns frc'Hi a second questionnaire^ adni nis Lc rcci to all 1J:K Kello^/s 

il :o yLelt'etl <lnta relevant to certain of the.lr postoocloral ponls 

{*niin,ireu vllU the Jr percenticn of tlie :)oscdoctoraJ j’nal’? Iielri for t'lon 

l'\' :,t; facuHv, TlTes»‘ items e^iiH resultant ranV.inps on tlion appear bclov, 

'',[uV <r rde r-- f ‘M" lilpi\est to Icrvest — the 5cillo'ii>r pos t-'doctoral 

T<tlvltics on Uie basis of your cjn preference; 



( Ave rnpe) 

j:au l- Act I vl ty 



I 



I 

> 



Keseard^ la an l< d (enter 

i'Csoarci^ in a Vepionnl I.aboratorv 

director cl rcsearcii tr\ a Icirpc clrv scl’.ool 

lest- arch t^nd tench! np In a sralJ (less thnn 
oi un i V(* rs 1 ty 

Pescarcu anJ teach in; in a larce (lh,OhO+) 
leacbliip ■'ll Iv In a onivcrsltv 



system 

A,CO'^) colle^’C 
univers Ity 



W. '.ink ordc r-“ f t orj "1'^ hl»niest to "o" lo^;est — tl'ic foliirclnp nost-doctonl 
accivitlc-s In tern's of what v(;u feel t^ie II- 7'. hi re cto rs \.' ould like you 
t<- 're noinr s'lien you fin Inn: 



( ^vc rapo) 

i'.nii A ct 1 vi ty 

4 1 esc arch ii iw ^ i 1 Center 

1 Icscarca iti r\ roricnnl l.akoratorv 

’ hirer tor of re sc area in a 1 irre city s.iccl svt:tcir 

f r on Ibis c'uo > 1 1* t^ae I ^e {!»oreafter refcTnof' j: hic 1 1 lornn i le i/1 

lar^npluMt this report In Hcctloas to v ,:< * , / *r< roat rcl«vaat, 

/ t c‘p'’ rh tlic entire instrument appears In yfp»a' f • -i.^s r<2port, 

1 



(Avj*rni 



< • i I V I i y 



\ «'in<! tcncLinr iri a sralj ( U^.s.s llwia 4,UU0) college 

or ur\i vors 1 ty 



1 



Kcaearch and tcachlnp in a larpe (10,0(K>+) univer^iitv 



> 



TL' icl;fnp only In a university 



IL li; apparent i roni t’ae al)Ove data tliat tb.e postdoctoral erployment 
ohjecilves of Jollox’s and tliosc of the U.R faculty, as perceived bv the 
corrcnporui a I trot; t perfectly. Ihc actual objectives of UIV. 
r.irullv correspond almost cofrplctely Cl;ose of Li.P relieves, 

i.Kp 1 oyi *eii t in a collvpc nr ualvorsitv sottlnp is ro^t valued, with regional 
! a!n>i al. a ries and resaarch ,tnd Jovelopncnt centers boifir next tu <!csi rali 1 lit 
..n I- r pc ct i VC cmjWoyors. It sijculd be noted tliat the tiiree ''place of 
•wori/’ objecrives ranked lowest by the Kclla^.s were those that were viewed 
;r; on lie s I Cab le , hefice nnn-ob jectlves , by liiP faculty, hut were listed 
solely Ln obtain rcMctlons of the trainees. 

It is also clear tiiat the Lt'R Fellows accept the stated general 
oijpjfLive-' fivr the LM^ niul view them as realistic and ccirpatlblc v’ith 
t'loLr objectives, althou),[i -in* re was slltMtly less inclination toward 

-r;iir. inv a research adml n is t ra t Ive role or navtn^ a research internship 
in naiionai iurricular projects, t,tate departments of education, or public 
V. cl ' oo i ',V: - 1 * 

Jld/ I va le nt ton 

1.1 ^b-pterber of I HW) rk jrlof resnonse sb.ee t sent to each cf 
l ic \2 IJ f FoJ1<a;s III an ntteTrnt to i<!entify prorrar* areas or activities 
’ osl ir ii,:oci of eva Ju..ti('n, llie results which appear below were helpful 
in lociisi'ii* the evaJui^tlon .'ict i v»i t ies ren^orted Ir. t<;0 lollcr.iaf suctions, 





in; of 

l iun: Die lUrecLors 

HATt. : U Sej^tti.'bur V)h^: 



ore «it t ?.r;p tin;’ to I'cterrine thr= ;«;pcrts of tlir pr<»r va I ch 
ronrerii you rr; 0 ?i c no tl;at we can concentrate on therr in the «'innual evaluation, 
t' loose respond to tic follo'^in}' Iterns hy irulicotinp Satisfaction, Indifference, 
or nissatl s fact Ion v/ltli tfie way cncU Is handled: 



(Check ^>nc) 



Are a ^ 

1, Selection of Fellrrvs 12 

2 * I nto. msh i b 

i, (huvse • ‘orf 9 

A, :'oney for ;:C 1 pcitd'^ , travel t^ conventions, 

iJisne rt at i on typln;’, etc, h 



felWv's (>r(jp,rvio; of indopondont or dissertation 
resenreU 'I 

love lea I facilities (space, <lesks , etc.) 5 

/. Seriirtnr cpp loy t after graduation ^ 









3 



e 



]) 

n 

A 



3 

1 . 



ifll' Cu rr i cu luni 

l.u.'t Jellow is rcf;uiiC(i to studv a core of research tralninr courses, 
f.evfiiul this preparation , each trjin*ie has t]\e cpportunlty to elect additional 
• . rolevar.t to furthor specialization* l.nch of the tviclvc trainees 



(,o vM.i In tho cratnin< inoprtn i or the 190h-’f>9 period w*as asked to ev«3luatv 
ihi- rnr«' rr^ur ’es t-;hlcii i:o Ims taken r.s a graduate student. Hie follcr^ln*’ 

VI 1 tti'u ijis t r -jct I ons verc pivea i f.> cadi I'ello*?, 

Your evaluation of the jntent of tlie core courses chat vou uave 
c^'K.plaiod topcliier ^;iu^ yrair eviilujtlon of the ins i rucL o rs of these 
cnursc:. will provide tlio silr.iiiltjs aOid supnort for proposed revisions, 
l‘ lease l>e candid, 

'hnko Your cvaluattr»n In terr-s of tlie object ives of the 'Jraduate 
terearch Irainlny rroprar'. I'iaci vo^ar rat Cups to the rlyUt of the 
eoiirse aurher oi\ tiic adjfiicat fort, 

Satfnp hodi* for c ourse ron t an 1 1 
ti -jsrUnUJnl 
!•: If.'hlv (hvsiralilc: 

t: i.V's 1 r ,<h Ic , hut oCiict nct-a erj ,il red courses vcmld he cmal In va‘u. 
I': ru't :is valuable cls otliet Possible eJoct^'’'S 
K; (d liltlo or r.o vnlue 



lur c* f i t!CLi vc‘iioH'". of prt>.s<:ni;it I un icc:iin I use<l )jy 

by tiu' Instructor in comriun 1 cotlnj* course content? 

A: extremely effective 
B; quite effective 
C: adequate 

D: sonxjwiiat ineffective 
K; extrcnely ineffective 

Your reaponyes will be hold in strict confidence and nar«s 
not tie asHociated wltli information on t’nese questionnaires. All 
responses will he processed bv an l£R Fcllcn>^i 



'Hio required courses are listed belcw alonj: vith tlie student evaluations, 
A NumjTiorv of evaluations of elective courses Is also Included, It is 
irtpuriaru to liear In nind chat these courses were evaluated with respect 
to lltclr contribution to the objectives of tiic C-iaduntu i^esearch Irainlnp 
Trorrar. and not in relation to U;c sLudonts’ own objectives or those 
nf other stiulents in tho university. 



Summarv of Core Course Evaluat ion 



Frequencios of Fatinp 
Course Rating Instructor Ratlnp 

FflucatUn ACCDLABCDt 





rMur, bCrit# Methods 


6 




i 




3 


1 


1 


2 




bt) 


Ad, Msych, I'ound.ations 


2 


2 


4 




1 


? 


2 


2 


1 


b r>-'j 


Inter, Scat, ?!ethods 


b 








3 


1 


2 


2 




bll-J 


Ad, bduc. Meas, & tval. 


10 


1 






V 


2 










Ad, fioc. Found, of Educ, 


1 


4 


2 


2 


3 2 


3 


3 




2 


bvi- 1 


i.vnl, of Sch. Sys , & Pro, 




7 


1 




4 


7 


1 








Methods of Cduc, Kes, 


h 


3 


1 




3 


4 








i 


Fxp, Mes, 6 Anil, I 


H 








j 


2 










lixp, ikis, 6 Anal, II 


7 


3 


1 




b 


4 


1 






q hs-'j 


Intern, In Fd, Pea. I 


7 


2 


3 
















(ixlerti, in P.d, Pcs. II 


7 


2 


2 














h lU-:) 


Intern, in L'd, Pcs, HI 


7 


2 


2 
















Intern, In ibi, Ics, IV 


1 


2 


1 














/ofl- '• 


Masters flies is 


J 


1 
















l';y c:i« 


> 1 opv 






















';i*hi*r.tl M itl?itfcs 1 


4 


3 


2 




1 


J 


3 


3 


1 


b h ^ 


i.ener i ! b tat f «;t i c.s fl 


6 


1 


1 


1 


3 


J 




3 


2 




'etn. '-s, ot Soc, Str 


, 


















fc 1 


'n U i . . . c Analysis 


7 


4 








1 


J 


3 


2 



I!' Is course lies not been offered durtnp the porit^; covered by this report. 




w n 

4'J 



}'re(juoacleM of Pnt In t? 

Course Hntlnr lurjtructor ^^attnr 

A (i C 0 i; / li c D L 



* It.'itljcsnvit 1 cfi 



2U0-3 KnUw for Soc, Fcl, I 
Hatii* for Soc, Sci , II 

Comjtut Scion CO 

1)1-1 (imrp, Av'plic. In Heli, Set, I I 12 



As w.is lUo case In previous reports, Fellcv'js rated covrses 

In oxperj n\''n tal design reasurerrent very f'ppcsicelv, courses 

in social auO psy cSclopl cal foundations of educoclon are rated lo'v, 

I tist r»jct Ion in the later tv^o courses Is likewise in necfi of l^ prover^nt , 
instructional prol>Kuw In Psyclioiory (General Statistics T/) Indicated 

dvirinp, tlio acadoiric year liave been arellorated coujlderab )y ^ 

since the 0 nru^ I racinps carrv over f ror ratings of Fellows takinc the 
course In l‘lf)7-6S, 7'his is also the case with Fsydiolopy fdll (I'ult Iverlate 
Ajinlysia). ft is noteu-orthv cluit la spice of Che af ore-rient ioned tnst ructional 
l>rol>len«, I ho content was considered valuable, 

FInci! tinv* rc^iiii reTTinnCs have been lessened fror 600 to 400 hours 
per viMi lor the inten^si.ips , tlielr reported value !»as increased, 

Ou? iLcr> each fron Qu istlonna^ res A and ii also yielded trainees* 
pcrcepti<ii'U ol the value of the Core Currlculur. F'esponsos to tUcs 
Itcr.-i -ippenr holo^; aud are nair-explanatory , 

(!<;nv:ept s 1 1.1^ ( t ic l urrlculur 



loo MtcJc l‘recdop 


X 

U 


/ 

T 


X 

i) 


4 

iT 


5 

0 


6 

0 


1 

0 






Ton Fuch Xath 


0 


0 


n 




2 


4 


1 


loo Little 'lath 




Ion liooreLlvai 


U 




1 


9 


1 


0 


u 


f oo App lied 




I'f^orJv lX*slp.nt*d 


0 


u 


1 


1 


3 


2 


3 


I’fcll llesipned 
r on ply 
/'r roc 

1 2 3 


*•'1 ronplv 
I isapreo 
4 3 



i:>, 'h»’ rf:o .-irch trnlnlto; core cc-urscs were 

roTt'v.jjii to the prorvan^s objectives, 6 3 10 ‘ 

* IV.lJu,s; coj'jiur Into tne prop run durln® tno rast v ■ vr imve already had 
'tulfl'li-nt t,,ickt'.ro«ind In this area. 




In aiiditlon to ciie core curriculum al)ove| an intef>ral, but non-credit 
roqulrenxjrit of the tralninr program Is the active o^sociation of each of 
the Tencx/r* v/ltb UiV oJlera free consultative services to graduate 

students ami faculty in the planning and conductinp of educaticnal research 
projects. A slp^llnr service Is provided Cor r*d\col districts, curriculur 
projects, and otltcr educational reae.nrcli related agencies and preups. 

'i'lif as'^ociat Ion provides the Fello^vs with the invaluable experience 

of helnp confro[iCed <vith actual prohlens iji the <lesi:n, me as lire iron t , and 
nna)y;;is of i!<Iucat 1 onal rtisoarch, A concomlt«int service to ^^raduate 
•■Ul^^cnls, fiKuity, and cducaLlo.ial proups j rs tl;erely provided. 

Al l I'e Mows chose- elective courses, idilch on the v’iole, vcrc reported 
a;: l)ene r 1 i:inl , Ihey ineJuded the follcwlnp areas in declining’ order 
ol frc<|uency; 



Course Fatin p Instructor Katiip 



Area ^ 


n 


C 


V i 


A 


B 


C 


D C 


Ihsychulofy 5 


3 


3 


1 


3 


3 


3 


1 


Sen. In IVisipn ^ Analysis 3 


4 


1 




2 


2 


3 


1 


llallienotlcs U 


3 






3 


1 


3 


\ 


lihicati*ni 1 


4 


6 




1 


4 


4 


n 

i. 


C'ninpiiLcr Science 3 


2 


1 




2 


4 






:usv. 


1 


1 


1 


1 




1 


1 


VI . Trainees 
















A. Sc* lection of U.K )'e 1 lows 

















lecruitmenL letliods include Liic distribution of brochures (sec 



next par.c) to leaders in tuc field of education who ri pUt have contact 
wlt!k i>?ortpcctivc KolJo'vs, to state deportments of cduci'tion, and several 
nc'ionl di'itrlcta. Approxlrate ly 2, Hun copies of the brochure i>*erc r«al led 
l.isJ vc.ir* Ifovrvor, referrals frorr persons in other Institutions who 
nri* famlll.’.r wf tli the riroprarr. remain the sln^'le most Iruortnnt neans 
of recrultlnp '-.ood prospects. Also, recorrondatlrrn of pr -sroctivc 
new I 1 levs frot K^jJtrvs already In the U'.V are valuable. 
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rfiiewsiin w eoocational iesearch 

IJlHlcr pnivisiufiv of I iilc IV i»! Ihi I kiiK i uni 
■Six:<NDil<uy 1-AjtK‘iiiHMi All <»l tin. I'mu imiv ol ( oh)- 

r.KV) Will ^iw.irilcAl >»r:inN loi Ilk .’f <■ .l.iMrsliiik’ .* 

of fultic.iluiiMl Kcvjirrlj | f t U i (o rv\' ,ks ;i 
vchicK* loi aNc.inli hi aiik.iinm I .ich 

ScfilciiiKi uN*iit Imir I.SI A I Mic IV I i lUki'vhipi aro 
nimlc .iV:HlabU‘ fo sUkK-oI** Iv^iiitinv fuwarJ llic 

fn Si'pk’mhci / / /V will i i>u i iis Inuifh vlmi 

of A^icrafHin 

nOGIAH AKB TERSOKNEl 

lliKk’f ihi' ilnrtlsi»ii ol Dr. KA riiitllj i> li>)|'ikii|v ,im.J I)r, 
(iciK‘ V tJ H i^rosiiks oli/warinn.il 
wiih' 

(M a inalliiAj*ji>p mfciitiM ij>luurv curjEcikluiu 

.f|for<K IhuIi itii tlnxlolopka! .iiiaI vlcplh 

taadiop ici ilu* I'h D ; 

<?> a l!c\ih!c pfiij;iam .ill»r^iiiu‘ auJiMdiial v|icVMli/.i~ 
lH>n in A pailrvid-kE .Hc.j ikl ^UiuMlJknMl kvcmuIk 

f .Ij roniiiiuoijs cipvtuntc \iilh .ictfial prk^j 

rets; 

<4| an iniK^vafivr iiilviovhjjv j’rouarii m Vvj^i^h IaIImnvk 
io.iy oblain I’xjviu'iitv fTf iho i\.Acaich ifwp.irMoaji' 
of *<hi»>K aiul Male Ali'|».irlnk‘iUs ui^;catfor\ ji« 
iIk* 1 )ivASi<)n\ of Kv.'sc-iii Ik of ki.'>:ioiMl f Likk.iUon.il 

laiboratorjcs, or t>i\ v'omuiluui <K vl loprrxni and 
evaluation pnA)ivis. 

I he JWxihk core A>f dk pMpiain inL luik> aL.idinne 
work III tk‘ folk’wini: arc.iN; ik ii. inks of faLullv iiK Milvt> 
•linmurily rcsj»ori>i!dc fiM L-.kh au.i .ire .I'v bNinf l\ lo\s 

|)fs Daniel I. Ifailey ■ - f\ycli and ( 'oinpiJtir'ijj 
ScierKt‘. <i. V {ilas\ j iluc . K. I> Mi»pknK» l\duL.. 
fulwarJ J. C iii.'Jkii ♦ JNyili. 

Kt M’orth Drs Marojif M AtvLivMi - 

Hiluc , (i. V Cij;is.N» K l> ffopkin^. 

:'4'mfHdUnMSifrihv Div I). k liaiUy. David M m kUK - 
Pbif, and ('iKiipufint. ScrciKV 

f)rv (i VGIiss, K,l) Ib^pkins. 
Mt*auurm/'nr o*ui f.vuhHifhut: f)rv O V (ria ,, K f) 

Miipkoi'J. Daryl I . kukk'i- I’tlui. 

^fuithw$ft/r Drx. IX.’MiK)nil < aM\vr:plU INych . 

Davrtf H. Saiindeis iNych 

i'rjibtihthfY uni Stati^luo Dj irvii i! Uus', 

*-Maih, 

/*nt Df** I yfe f Ib irfiie D i .nlw’ u I l, 

kcnikth K, ll.ifuMhMiJ iSyili.O I JIavav l'*.> Ji . 
KiikifJ Jc^vM l\>di I* J < mtlki' I'.ytlk . Kon- 
.ilJ Johnyvn -f\vch 

/Vd/.i.K./j/ivof VrohV Dr D ivi.Uf.iwUtiv 

Jn .KktitiiH) |fk* pfo^l.Hii tii; hi^li V a U pi.utiLiJIlk 

and ;*p(YiUimafc)y V() HOksicr tnuji*. of i in in la ffiou 
who enter the |>rn>:fam wirb k .Mavfcr\ ik, ice L.ak cx^Vi t 
ihcir Ph l>. m f\,o years 



(pr.idualcs Ihc j t«'k ka!u will he pfif^rcd to assuriK' 3 
|xvaUoi> III ( I I Lo)ka> kad iiikiwrMtics. (2f ascareh 
dcvLliipmcoi ank r". • • » iceional L-xfucatiunal l«itK>rat irrcs. 
|1) Kscaixh ik'j' 'aruit' o! M.ho<d diMiKh. or i i st4iii 
dcparlnKiits k>f edik.Mu i; I b ■ !n>t h)ur k’raduaic'* of /. 

Uv>k (XAihons ai ifu I la^ oi Hlinois - L'rbana. I niv. i>f 
Waslkiiijjron- SlmmIc, I mv ol Soulhun Cahforniii. and 
the rducaiioiial IKvcNymcnial l.aK^ratorics 

f\mm SUPPORT 

Si'scral three-) ear .idu.dc fiiUneshlps arc jvailjbic 
uuh ‘ti^vemis of anvl S2K0U (or the first, 

sceond. arat third \ea' . ivsiveikvcly fwi^yoar pv)si- 
Masters fellcmslups p.i\ S26(KJ and $2Ki.X) for the two 
years In addition >5fHf i> allowed for each dcp*endcnt 
each year. A invcl .\llowaacc of per imk from the 
candiilafcs plaee oJ r^vkleikv che Urtivcrsiiy of C ViloraiKv 
will hv provided I h.' stip^ndv ure Ux. tree and carry 
■vvaiver of tuirion aiul fees. 

msoiKR Of f{iiflyfS«!PS 

The primary eniLii.t ^u’eiran^ the sticclion of feHow- 
ship recipients are 

f. fh^:h . I( a<<(V nih/f AS rdkscicd in 

(.!> A jiijuiJiaan underpradualc p*Mnl of 

a I) (on .1 4.0 scales with ;;t ka.t .i 3 5 
pr,ide .iver.^, o?. i.i) j:r;idujtc work 
uiiii| Kied. Transp.fkpis of ah academic work 
aie reqiiiKLl ^nh any unjef^radttate 

fJhijiff n't' ( ro ci/;/d\. 

(bi A mininu.iii combined score of 1?50 k^r. :hv' 
Ou.aitit tine and Wrba) Aptitude Seciiors 
(wiih ( aiantitative score of not L*ss than 
/>2^/ iW die Graduate Rea''rd FianiinatkJii. 

If ' Hi,' k^rnumi ExpenftK€ as rcfkkted 

in: 

(a) A strLWkj! 4merOisciplfn^ry preparation C oh 
kpe v oik iji matlK-rnuties is csscnliai uidcss 
GKf: Oa tiiin.itivc score iv mdicalivc of ex- 
ceheid (ju.inlilatisc uptilude 
(bj Ac.idiniii werk in the tvh.iuorjl or wial 
sciencc'^ 

IJi fnic/csi Of ;inj ( tiouhiiofttn :o a (o'tir m 
tiofial f\rs/nnf{ .is rejected in: 

(a I 7!k LandtJ.ite's profcsMon.il objectives 
(b| Sapfstjtme IcKcrs of recxirnmenildhon 

m\wm pRocfsuRfs 

For cpplicoiiOn h:rroi .sn'c to 

Loborot r/ fJ Edocoi cooi Research 
/VVcKerir>Q Lfuddirsg 
Un t vers I ty r>f Colorodo 
Douldcr, O hfodo 80302 
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of tiKi twelve Follows presently In tlie iJillf, nine of then stfite that 



llielr first knowlcOpe of the prorraTn wns enlnccl f rop persons at the 
University of Colorado or other institutions wlio knev’ of the propran and 
re common do »i that they apply, lliree KellcKVs discovered the program when 
t)K*v wrote to the Colorado ('roduate School of l^ducntitni for inforration 
alumt a oropror^ oriented ta/nrd educational research. Ihe Graduate School 
sent them copLos of the brochure and they then cormuni caicd with and 
to t!ic LXK, 

>t would appear Chen that tlie rass mailings of brochures do not 
onuluce very satis (actory results, f'c-rliops the broeikures do initially 
inlecesl tail I v l.ifua N la tiio prograin, inU the fact Is that of tlie I‘cllf//s 
nltii.^nu»ly selected, none were recruited dirc-ctly a result of tiie 
na-s brochure railing metiiod, 

iVrruiLiaj’ efforts brought approxi ma te Iv sixty ''five inquiries and 
requests* for applications, 'Ihis is fifteen more than the previous vear, 
bequests for applications whicli v;ere ultimately not sub nit ted for considera- 
tion wore received from the follnn/inp locations; 



Locations of I'equesln for Applications ’’hlch 
Uere Sot Subsequently Suhritted 



ArJ zona 



1 erwa 



furij In {/) 



North Carolina 



(.cnadn 



O!iio 



t:olorado (3) 



labor, a 



1“ lur Ida (2) 



i'cfirrr.’ IvanI n 



riHnols (2) 



Texas (3) 



I ndl a 



i 1 1 s c on s 1 n 



K 




Indiana 



Tliorc were 3 7 npp 11 cn Cions sul)rjitte<J, wliich irt nnoroxlnate Jy 17 more 
tn.in the previous year, Mio locations oT the 37 applications follow: 
Locations of Subnltted Appltcatioas 



California (2) 


Nebraska 


Canada 


North Dakota 


Colorado (7) 


Ohio 


Florida (4) 


Orejion 


Illinois (6) 


Taiwan 


Kentucky 


Texas 


:*assachusett.s 


Utali (2) 


'M chipan 


\iasfiliict(Xi 


Minnesota (2) 


'I’aslUupton, , 


Miss our 1 


Wls cons to 



It is In tereatiiif. to note t!iat alonp with the fact t!int there '>ere 
n Ittos t tv ice as r^any con Pie ted applications in 19oH-6^^ as in 1967-6 8, 
there* were also t\;Lce as rvony locations frorr which people *^cro 'aoplylnp# 

Tnls woiiH seorr to indicate that the IKl? proprafl' Is becorrinc i^ore i^ideiy 
l< o i • 

tlic 37 subnlttad eppll c^atiens , three were aclected as LLL CSLA 
1*4:1 Jews, ()nc- person received ijnancial support fror MLLA and one received 
support fror' the Lnlverslty c»f Colorado; both were accepted as IXH rerbers, 
Hhc criteria used in eelectluP Fella^’fl fror applicants are stated 

In tfio Jj;i’ brodiure. llic applicant in order to be considered for acceptance 
t-HiHr Iir»vo had a prade point average of 3,0 In under^^raduate work and 3.5 
III any graduate work completed, /n )ie must have had a Crdauatc Pecord 
M.x.imi nation cuinblnet! scora of 1230 Oii the Quantitative a:ih Verbal Aptitude 
■Sections (v>jih n (|ua:i 1 1 1 at 1 ve score of not less than 623), In a<Idltion, 
a itn^nr hori.rrnun*! In p/itherailcs wais considered to bn very Irportant. 



^ lU 



o 

ERIC 



Other qualific»<tioiis of the applicant which were considered were his 
(tlio nvernp.e np.e of 1‘cllows this yi‘nr is 25.2 o?? confrpnred to 32.5 the 

previous year) » the clarity with which he expressed Ufa atcteTf«nt of 

objectives and reasons for wanting to be in the propran, and the recoirioenda- 
tions about l»iw from persons known to be kna<?ledgcab le about the fii^ld 
of educational research, l^ienevar possible i the program director held 
nn interview with the applicant. 

Up until this time the directors of the program^ who are the seJ^ctlou 
ccwnlttec^ have accepted only one wor»an as an ESEA LEP Fellow, The 
feeling hoa been tliat if a ciioicc vrore to be made bett^een two equally 
qunKflod applicants, one male and the other female, they would choose 
the male iis the recipient of the ESEA Fellowship. Tliis procedure is 

baicd generally on the rationale that, in the loi^g run, a rule would 

be iho botCur luver.tnont because he would be more likely to copTplete the 
trulninp program and thei> go on to be a productive educational researcher 
over the years. 

ilowevcr, the validity of this rationale is open to question. Jencks 
and Klesman^ ritace soine of the reascnis why graduate schools are strongly 
prejudiced against wonon. First, tlie schools expect that women with graduate 
degrees ul 11 be married and have clilldreri and will not return to their 
profeurt 1 i>na 1 v;ork. Second, It Is expected that more women than men 
vllj drop out of their degree prograriS and not put their education to use. 

however, tliore Is no body of evidence which either supports or refutes 

tl:o abovi* stutencunts, 'Ihere are, however, remarks whlcii can be made to 

liolp round out the picture, Jencks and Rlesman state ’’The professions 

rav have very narrow assumptions aiiout what kinds of work are valuable 

an<l whsi kinds are not,” Also, ’’The woman who drops cut and does nothlnr 

laiM.iule ..'i th her ci'ucotlon often rakes an Intangible contribution, both. 

Co :uiciciv and to the graduate school In ulilcli she i<. briefly enrolled.” 

1 OirlSlophcr loucks and Uavld I’Jesman, Ih c A c a J o - U: ^ • vo i 'K 1 on , 1^63, 
t)ouhleday and (;or>pauy, Acu York. ^ 

bb n 



Tlie tlon Uere is that those in charge of the selections of 

\y.[{ Follows seek out evidence for and against tlieir present rationale 
of prejudice against females, and eit er maintain tlie status fiuo if It 
Is reasonable or revise the selection procedures to permit females to 
compete on an equal footlnr with males. 

h. i:nro] In^nt (/Ml for a Full Year) 

1, Total persons enrolled In training proprarr, 1968^69 

Third Year 

Ralph hakstlaa (i:SkA) 
yasaliito Okada (I.SKA) 

Arthur 'VUite (i:SKA) 

Glenn Uraclit (NDl^A) 

^cott Harrington (^40CA) 

Second Year 

Danie 1 Bauman (KSl^A) 

James Collins ;8SEA) 

Stephen Jurs (ESFA) 

Robert Meodro (ESFA) 

Jones .Sanders (LSFA) 

Jon *:orrl9 (NDEA) 
rira t Year 

hhincy Burton (University support) 

2. Total persons enrolled In training progran, 1969-70 

Thi rd Year 

Daniel Oaunan (ESLA) 

Janes Collins (FSI:a) 

Stephen Jura (LSKA) 

Kj H 




Uobcrt Mendro (LSi:A) 



»l«Tmcs Sancle rs A) 

Jon Morris (NDHA) 

Scci>nd Year 

Arlcn CulJlckson (i:SiCA' 

MiJlUitM Tood Uo^^orrt (KSJ'A) 

I'.ory Knr^r (University) 
iinnev i^urton (Unlvcrr^j ty) 

Tirst Year 

l:obert Alircus (KSHA) 

Sus^n OldefcruJc (N'OUA) 

3, Tntj] persons enrolled in trainnnp pro^^rrn', 1970-71 (estlrated) 
Vtiird Year 

Arlcn Culllckson (USKA) 

William Todd Ko>:crs (KSKA) 
iJancy Surton (University) 
iioL-y Ketner (University) 

Second Year 

Tobert Ahrens (HSKA) 

S V i s ; u\ 0 1 d G f c n d t ( M U h A ) 
rirst Ye <^.r 

new Fellt^vs (5 liSIiA, 1 '.DU A) 




K 1 ^ 

57 
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radua^c averages not calculated on a coirp arable scale 



SevcfJ concinuin)' J'eJlowM ;>rt* liirludccl tn tlio jirof^r.-ir* 

Tlic folliwlx\}‘. list Includes llio title of their dtftser tf\ti nns nn<i 
llieir jiuh 1 icat I ons aiid research ^n'ojeccs corr^pleted durlnp 1968-69. 



Pan lei d. ilaumau 



Uoctoral Uissertation 



(JianviG in Expectations in V. elation to Chance 'ti Copr^itive 
Knowledge (in progress) 

Tull Heat Ions 



Effc‘Cts rf t!ic 1’ os it ion of an ^Organizer’ on Lea mi up 
leaningful Verlnil Mato rial’' (viti^ Cene V Class and Scott A, 
Uarrlnp^ton) ^ Research V ape r ilot Lal)orator>' of Educational 

Kcsoarcli, University of Colorado, Sen tender 196 H, 

*'A Computer Crurran for Lata Summarization/’ Lducatlonal and 
Hsy ciiolos^i cnl McflSurorLcnt (in press) • 

.jjucy Uurtun 



i hii) Ilea ti ons 

Author ' s Guide and Style Manua l for the Keview of Lducatlona l 
Research {with Cene V Glass), American Educational Reaeard’j 
Asnoclatl on , Loulder: Laboratory of Educational Research, 
UnlverslLy of Colorado, 1968 (Offset), 

'^Course Kvaluation Inventory," boulder r Laboratory of Educational 
Kosrarch, University of Colorado, 1968 (f^ffset). 

Jar>vH I', Collins 



l.^nctora? Llsnert ati on 

Jucklcniflnr Genera Hzabi 11 ty (in progress) 
On, 1 1 1 call on s 



'*Hcviow of dagpn ley's Matheruiti cs f or Introductory Statis tics , 

/ )*ropr anuned Keview,” Educational and rsychological Measurenent, 

79, 1069, 722-72!i. 

''fkionctric 1‘roo^ of the Kestrictlon of the TossiUle Values of 
when _r^^ and are Mxed," b ducatlcnaj and Rsycholoel cal 
^^oaa^fe^Ty!nt (in press) 

i osc arrh i n Pro,^re^s 

h-.'urcor; of Variation In ^*ultlple Ic t PtrfotranCo (vlth l.avld L, 
1 U*y and Ge ne V G lass ) 

i^or p t .Vetliods fi^r Ventli’e. 'fc n-i n<j : ; i.u 

C v I (icioiu:! (witii K. L, l(c;>kirifl) 



Lorrclation 



Sto^^lion C, Jucs 



IJoctoral fUsser tatl o n 

(J/jujja] Inference in the Input-Output Model Applied to Secondary 
Schools (In progress) 

Pul) 1 lent i ons 



Hiia tery Test 1 toms or ( curses In Ltiucatlonoi Research !<e c h od n 
(with (^ne V (rla.ss and Jrnnes K, SanUera), Arnerlcan Educational 
Ke^enrch Association , Roulder: Laboratory of Educational Research, 
Unlversttv of Colorado, 1969 

Research in }'ro;^res.s 

in'ent ul i'ortallty 

Hohect L> Meiidro 

Doctora 1 IHs^o ct at log 

A Monte Carlo Study of Multiple Corrparisori Prccedures after 
Analysis of Covariance (in progress) 

Puli IjcA it ons 

’’Review of 1 uferen tla 1 St.at i w tics in the behavioral Sciences 
hy SiieiUon (Tj E ducational and Psy dr o logical Mcasurenent 

(in press)* 

Jon \.0 ^^o^rls 



doctoral Dissertation 



A Study of [lode Is of Student Flow In Unt'^ersitv Structure 
(in progress) 

)amL‘:) F. Sunders 



Doctoral Dissertation 

Short lerm and Long Term Kc tent ion Effects of Adjunct Questions 
in Audio Discourse: An Extension of Research on Mathemageni cs 
(in proprosa) 



Pub 11 cat ions 




t rty I tetns for Courses In nducatlonal Research Me t hods 

Tv’ith Cene V Class and Stephen C* Jurs), American Fducatlonol 
Kuneatcli Association, Uuulder: Laboratory of Educational Research, 
University of Colorado, 1969 (Offset), 

"Ail Exploratory Study of the Effect of Selected Variables upon 
Te.KuCi Expectation of Pupil Success" (with ;v’, L, Goodwin), 

Pf(pcr read At AFKA .\nnunl Convention, February 7, 1969* 

^4.PJ 



bO 



J kvsfnrfii i r> P r 

Con:iequf.*nccs of ral]ave to iMoct the Assurpiloas Dndcrlyin^^ 

^.lic AnaJynli: of Vnrj nace. (with Gcue V. GIqgs) 

t'rof i U ? jDf C rndiirae s hrorr/in 

Porhnp'i Llio rior.t vaJid cvnUntion of tfir. <;ucccs<; of n 
rcfjcavo traiiUup profT^^n H cs iu aine^yinp the subsequent research 
iuvojveiivnt am) productivj. Ly of Ity graduates , Mine vc11ct./ 3 have 
gratlu.Uod fro;n the I>:K; four In 19GS, five in 1969. In this section, 
rcJucntlonal data mu] indlcatots of acadeni c progress arc IncJudod 
for the- J96K.--09 grruhiatcs, whi ]e prc.scat position, title, and research 
puhJlcatloiij nru included for nil graduates 



Biograoiii cn] and ::duc;^t 1 ona J i)r.t a 

Ihc foilwing biographical ,nnd cducaticnai Cato are 



des Ci \ n Live 


of 


Uu' five* 


Fg ] ] o,/ 


s v!io graduated during the 


iyr)8--69 




pcii nd. 








0ndcrcrod\mtc 




Graduate 
kecord Fxaro 


Vc J 1 


Vr^ 


Aj:c 


GIV. 


Institution 


Major 


V 




n ^ah 


3 


30 


3.53 


Concordia Col,. 
Nebraska 


Fnp. 


490 


750 


14 aH 


3 


27 


3.50 


U. of Brit- 
Col. Canada 


Eng. ;Psy , 


, 650 


750 


15 a* 


3 


28 


3.00 


Unneas U 


Hist. 


610 


680 


10 nl> 


2 


37 


2.45 


U. of Colo. 


Oioir. 


610 


720 


17 nh 


1 


24 


3.23 


Colo. St. Col. 


\'hy* Scl. 


510 


73C 


Me .uis 




31.2 


3.14 






blh 


726 



I e ) i n • 

I Itr/ cc»r'iiC>Lod nrru-rar' in August, 19 G 9 , 
"Ke!]c>; rcc- deprea In Angus t, 5909 * 
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2* AcnO.tMuI c I' vof,n.v;s — ]90y“t>*) 



The following, lnb]i* shoe.; i]ic liours of acaicr.dr crcOlt 
ami ^unaL avi'.raj'cs c.arnotl c!uriaf, 196fi-C9 by t!ia five Vcllo/n 

wlio rr.uluaifil from rho I.aboi'tiCory of IbJucnCioaal lo.soarch. 



Vy 1 1 ov 


Scr‘n .0 to r 


Knurr; 




39 




I'.A. ]<j(,’d~C0 


Cur t! 1 at i VO 
C.P. A. 
l\ of C cj 1 o , 


Vduc* Vsy rh . 


Comp . 
Scii . 


Other 


'iV>t;i3 




i- d u c . 


either 


Ovc r- a 1 1 


13 a* 


2 2 
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4.00 


^.09 


6.00 


3,80 


\U a 
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3 
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6.00 


4.00 


A. 00 


13 a* 


5 3 
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3.00 


2.00 


2,62 


3.60 


16 a 


6 9 
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13 


4.00 


3.67 


3,77 


3.85 


W a 
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4.00 
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A. 00 


3.50 


Ik’ a no 


2 . R 2 . b 
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1.2 


6.8 


3.64 


3.55 


3.59 


3.75 



porr.oa:; oocb coirplrlod ci bhtl), thesis , which carries not official 
scMu r-icr Uovu a crotlit. 

**vlil!A iVllo/ 

lliG above dvXta inJlcnto outstantUiij ncnclrr'ic achicvciront. 

The ix'iaa point avcrajr;o for all vJorV: durinf; the 19Go-69 year 

was 3.09* llic p.raiUu’-tiaa Vcllov^r, averaj^ed 7 hours of courscvjork. 
(t’radnaijaa, rollo/s served tn?,c nisl^l pr» during, uach year and wrote 

i L .'ll vtns , both oC whiiU carried no offie-al ^ ^irs of academic 
ciodt t. All or; i sixty (39) per cent of the etjrs talicn during, the year 
Wo-; outside* the cnajov dcp.-ir trent , 1 lius t va t iu;^ the iatcrdisclplluary 
nature of tiic propraii. 
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lUc lolUwlnj’ List Includes lUc present positions, refioarch, puo 1 1 c,it1 ons , 
projects, and Involvers'^nt of tlic previous iJJi prnduatcL • 

^ Jlf lira chi 



Ass i .‘'.Lon t i’role.ssnr, N'ui dance and Kducatlonal ^’sycholopy , Faculty 
of t.dur«aLlon, tnivcTriity ol Southern Jllinois 

leach inp, jvssl pnr.on t 70 

lulroductlcn to Statistical IlctUod^i 
Intermediate JUatlsticiil Mettkods 
/jiViaiiced S tat is lien J I!eCl;ods 
Seminar in Iten tal lx;siv;n 

Summar/ of F rofess lona 1 Tlr.o 1969-70 

leachinp, ^*37^ Other Admlnistroti on 3T. 

I'uaearch 3f)>. Other 0/f 

lV*seardi Administration t)Z 

hoc ter a I Oisae rt ati ort^ 

Ihe I'c lationsliio oL' ircntuicnt Tasks, I’crsonolociical Variables, and 
iJepcndent Variables to Ap tltude-Treatment Interactions (7\uyust, 19b9) 

Ihj!) itcatienn 

Oomparotivf* Va lues of Ob j ect Ive ana Fssay Tes tine In Underpraduate 
t ducat ion t 1 rnp J Ic at i ons for Valid Asecssment of Ins tructl on « Unpub- 
lished il.A, 'ilieslfi, University of Colorado, 1967, 101 pp, 

”M>Jectlve find Ussny Tests; Do They Measure Different Abilities?*’ 
(with Kcnncjth I), Hopkins). Paper presented at a Joint Session of 
liie Annua] MeOLlnp.s of the Amerlcnn Educational P.cscnrch Association 
•md the National Council on Measurerent in Education, Qiicap.o, 

I'chroaty h-lJ, 196 H, 16 pp, 

"Ihe Lxtcrual VnUdlty of Comperntivc lixperircnts In Education and 
thu liorlaJ Sclenccu,” (with Cene V Class) Eescardi Paper No, 3, 
laboratory of iiducitional I'escarcli, University of Colorado, October 
19(»7, 6Upp, 

"Connuiratwc Validities of Essay and Objective Tests,” (with K, 1). 
liophiu;) Pose.irch Taper No, 20 , l.ahoratory of ihiucaticual Ecaearch, 
Unlv'jrslty of Colorado, lV,Loi)er 196 6, 23 pp, 

”'ihe* l.>torual Validity of r.?;pcrir.xjnts ,** (v/lth l-cne V (.lass) 7re rl 
} iUic.it I on .ll jh \sunrcli .l ev ' ' aj^ , , 6 37-676, U ove nb c r 1 * b 



(hi!i 1 1 Ion 



* ^ 





"M L’.valujtlon of ti^e Liiucntloiuil Krograni of /i High School Vsinrt 
n Modular Schedule: A Kollc^^-up Study," (witJi Gerald Speckhard) 
RcfioarcU Paper Ijo, , Laboratory of KducationaJ Research, University 
of Colorado, October 1968* A1 pp, 

"Review of 1*09 tie thwaltc’s School Orf^anizatlon and Stude nt Adilevenent 
A S tudy iiased on Achlever^ent in *'attierr>at Ics in 'Cwclve Count~rlcs 7^^ 

*lhc educational Koru n, 33 , 200-261, January 1969* 

"kcvlcw of Miller’s Statis ti cal Concept s and Applications , ^ Non- 
Mathemati ca] K yp I an at. 1 on^ ^ \ t A t ! i Rcnnetii D. Hopkins) iTducatlQna l 
and ray ctiolopl ral Measu rer>nnt , 29 , 221-223 , Sprinr 1969, 

I’rodiict ^valu.'^tl^m of New L'esiun for Learning; A Junior ITIrH School 
r:odel. Year I" (witfi Kenneth l>. liopklns)^ Laboratory of Educational 
I^e9(.*ardj, Univ. of Coir*,, iJecCfirljor 1968, 51 pp. 

"Ten-Year IQ Stability on Verbal and Non-Verbal Tests." !*aper 
presented at Al-JLA, Eebruary 3969. 22 pp. (with Kenneth E. Hopkins). 



C. Ajiu iirickner 



i’oo i t Ion 

Eva lu/i lion Li rector, I’ducoMonal Level opirent Laboratories, ‘JcGra^.'-lU 11 
i'u!>Jlshlnp Con.pany (Au'^uot 1968) 

Smyrna ry of Pr ofessi ona J Tirne 1969-70 



leaching 


OJ. 


0 the r 


Adminis t rati on 




Eascarcli 




Other 


(Public relations) 


20% 


Pe^eardi Admlnis tra Eton 


m 









hoctornl L) l^;sor^atlon 

Ljspcrlnental Analysis of Auditory Discrimination Skills In the 
iXve Icpment al structure of Pre-Scliool Children 

Cub it cations 



"l ffects of (<per.^nt Condi tl oninp on Frequency cf Polysyllabic 
'/urds and Speed of Response," (witfi A. Ralph fiakstlan) Psyciaonomic 
^H euco . J2i ^U7-2C)d, 1968. 

*hipi:rai.t Lorid i t Lcnim; of I'olysy I liibl c Words," (vitu A, Ralph Jiakstian) 
Ixcsearch P aper No. 11, Laboratory of Educatloiial Research, University 
of Colorado, June 1963, 

"l yperlfientaJ Analysis of Auditory Fllscrlninatleu Skills In the 
>r: VC lopncii tal Structure of Pre-Schoci Children," f’esc.ar ch Pape r 

^7 i Laboratory of l.ducaticnal I^escarch, University of Colorado, 
Scptcri>er 1968* 

'"hirrr.uivn Ilv.iluaClon of Listen Look I/iam C>cles K-4Q," Kcseardi 
and 1 n f o i n a 1 1 on D u i 1 e M n t! o . 12 , );DL, Huntington, N.Y, , Noverber 196^. 




rs. Jit 



'Mo I Irxv-lip Study of LU. FI rnL Year StudentH Wlm U?ip<l 'fr/iiU I J on/»I 
liwial Troy.rnpw in Second Year," KuMearch and J n Torra tt on ^<eporl 
, l.DL, Uuntii^g.tcn , flew York, February I960. 

"Reading Kates Attained by First Year Listen Look l>carn Students," 
Research and Information Keport No. 2, EDL, Huntington, New York, 
February 1969. 

"Listen Look learn livaluatlcm Manual," KDL, lluntincton, Sew York, 
February 1969. 

"Kvaluotion of Listen Look Learn Cycles R-AO in Corrective and 
Kcinedial Installations, 1967-68," Research and T ^lorriation Bulletin 
Ho. 14 , EDL, ilmvtington, hew York, March 1969, 

"An Inner-City Froject i^evclopcd by LDL, A Division of McGraw-Hill, 
for Mew York City Decentralized Sdiool Districts," EDL, Huntington, 
Ne\/ York, June 1969. (Mdreo) 

"Analysis of F.yc-Movement Recordings for a Sarrple of Secondary 
Students in a Private Tutorial Installation," FDL, Huntington, 

Mew York, June 196i?. (Mlneo) 

"Preliminary Report on Use of tlic Listen Look Learn System v;ith ;:ui 
Kuf-,Ii*^h-as-a-Second Language Sample," EDL, Hun ting ton » Mew Yoik, 
July 1969* (f'ineo) 

"A Proposal for the lexorkana Dropout Prevention Prograrr," KDL, 
Huntington, Mew York, August 1969, (Hlmeo) 

"Learning lUO System Use with Project 100,000 Inductees, Fort 
Pr. U; Tr.?ining Center," Keseard^ end Information Report Ko. _3| 

Kl)i,, Huntington, Mew York, Sopterber 1969. 



Husanll A. Uiadbourn 



Pos i tion 



tVinlatanC Irofusaot, L.ducatioaal Psychology, Facvilty of Education, 
Uni varsity of illlnoia 

leadi In p Msl gorfnn i ]9f> 9-70 

internodiate Stacistics 
Seminar In Rofiearch '‘othods 

Supi.ary of I’rof oss i ona 1 Tine 1969-/0 



‘loach In p 


807. 


other Administration 


\y/. 


Keacarch 


y/. 


Other 


o;; 


Research Adml nl str utlo.i 


04 







j^ uc t ov 0 \ iilssert niton 

M.ixlnl ration Procedures for Lv aorali zab ill ty Studies (January 1969) 




tiJ 



Pub 11 Cil tions 



Sdicm;i for Proper Vtlllz«Ttlon of Multiple Comparisons in Kesearch 
and a Caae Study/* (with Kenneth U, Hopkins) American Education cnl 
Kcsenrch Journal » November 1967, ^07-^12, 

”A Critique of Current Research Vractices in Mathematics Kducation," 
Heseardt l*apcr No« 7, Laboiatorv of Kducationnl Research, University 
of Colorado, l>ecerTber 1967, 

"Maximization Procedures for Cene ralizabi lity Studies,'* Research 
Paper No, 25 , l.aboratory of Educational Research, University of 
Colorado, January 1969, 191 pp, 

"Review of Noiniark -md L’sLes' Stimulu s Sat npllnp fheo^," Educational 
mul Psychological Mensurercni , ?^, 638-bAO , 1966, 

"Maxi rl zot Ion of C^nerolizobi litv under Cost Constraints," Paper 
rend at AJiKA, annual convent ton, lebruary 1969, 

"Multiple ( ompnrlson in Ke^enrch: A Response to a Comment ," Am.erican 
Kducnaougl Research Jo urnal (in press) (with K, K, Hopkins), 



A, Ralph i "kstlnn 



i*os iti on 



Assistant Professor, School of Education, University of Maasachusec ts 

Teach Aasi gnnent i96 9 -7 C 

Introductirn to factor Analysis 
Tost Tlicory 

Introduction to iiultivari.ite Ajialysis 
Intermciiiotc Statistical Methods 

Surrmary of V rofess Iona 1 'f 1 me 1969-“ ?0 



Tvachlnr 


333: 


Otficr 


adninistratlon 


r>; 


He search 


A 77. 


(Jthc r 


( 1) advising 


llv. 


iVjoearcJi /uimin 1st rulii n 


U7 




(2) corrrittee work 


57. 



Mrct nra 1 bis s o 1 1 '< ti on 

Methods of ^bKq jc i ransfoi rot i c-n (Auj?ust, 1909) 
I'uh I iratlotxs 



"t>perant v:oiidi t ! oninp of J’nlysy liable 'Jerds," (v;ith C, /jin brlckaer) 
Rxjsf'arch Pajicr No, 11 , l^horulory of LMucatloual Research, I'uiversitv 
of Colorado, June 1906, 

"ruL'vtc’' of 5, i', Uuisjaa, Per arch U:s1g^ . ijx C H n i c i\ 1 Irvchole v 
/iiil ^ uL rs‘ (with C-enr V. ' 1 1 a ;j sT "l^d u c a cl em 1 and Ps^'cholocl cal 

Mc.mcrer^nt , 2H, 621-(>'^3, 1966, * 







“Kcvlcw of Pluldiik, Foiindutiou3 of experimental Peseardi/' 
educational and ?sy clioloRical .‘IcnsurcTnent > ^8^ 972-07^| 19bB. 

of the Icur I'orcl r.n 1 .an %\u are Proficiency le.s t s dournAl 

of educational Meaaurerren t ^ ^i4-A6| 1969, 

"effects of Operant Condi tlonlnp. on Frequency of Polysyllabic %‘ords 
and Speed of Kesponse/' (witii C, Ann brickner) Psychonordc Science, 

J2i 207-208, 1968. 

"Mensurca of Association in Comparative experiments: Tiielr Development 

4ind I ntorpro tat i on (v7i th Cene V Glflss) Researc h Paper lA , 

Lnhoratory of Educational 'Research, University of Colorado, Seotember 
1968. Also in AKKJ , C , ^03-AlA, 1969, and paper piven at AEPvA 
annual meeting, 1069. 

"a Comparison of the Lifecta on Study Kethods and TCsS t Performance 
of UijncLive, Essay and (‘ombined Exa’^lnations R esearch Paper 
LnhoraLory of Uducntional Research, University of Colorado, Septeiri>er 
1968; Paper rend at AKKA annual convention, February 1969. 

research in Propress 

Validity atul Kc liability concomitants of Confidence Viol ch tine 

A Pro.tzram for orthogonal Potation L'slnv^ the General "Orci.omax" 

Cri ter i on , 



Scott A. tLarrinpton 
Pos 1 ti on 

/uwslsC^int Professor, Guidance ajid Counseling, FaculLv of Cducatlcn, 
University of :Jcbraska at Onieha 

Ve.i ch iup A^;si:;nment 196 9- 70 

Statistical Methods 

(iroup 'lochnlqucs In Guidance 

Practicun in Ihiidvancc: and Counseling 

! ur rar y oJ[ P ro{ ess iotin l 11 me 1969-70 

TendUnp 7!>/l Other Adriitil s t r a ti on OX 

PeseareJ^ 2bX (>ther 07. 

lATHcnrch Administration OX 

Doctor a 1 Dissertation 



fliU Effects of iKijic Encounter Kxnerienco With Prospective Counselors 
ocnnltivity to Mon-Verbal Copmunication of reeling, AcceptOi :e 
of Sell, ami Acceptance of Others (In progress). 

Uuh I { catl ons 




"Mrtjucncln/; ' Urgant >:crs * In ‘VMnitir.f ul Verbal l>carninp,'’ P>csea rdt 
P ipo r No. 10, l,ai)oratory of Kducatlcnai Kcscerch, University of 
Colorado, April IJOti. 



b "i 



"Keview of 'Survey of Study Habits and Attitudes,*** (with A, Koark) 
Journal of Jvducational Measureinent (in press) » 



?'iUialilto (Hcnda 



I’ortJ tton 



Staff, Keacarch and J)eve loptnent , Product heparttnent , Southwest 
Rer^ionel Laboratory 

GurriTAary of Professf ona l Tline 19 6 'J- 70 



ieadiing 


07, 


Other 


Administration 


0% 


Hesearcli 


257 


Other 


(1) Product Pevelc *r>ent 


50 


Keeearch Administration 


25% 


(a) 


K-3 Conmunication Skills 








(b) 


Problem Solving In the 
Social Sciences 





boctorcil Dissc r r £it ion 

Tlic Conprehension of Textual Inforrratlon Presented Xhrouph Single 
and Multiple-Sense Modalities (August, 1969) 

I’ub ] i cations 



"/-i /analysis of Delacato’s Lxncritneatal Evidence," (with Gene V. 
Gla^i^) Pediatric s (In press), 

HCHunrch In Pronresa 

Thenatic Preference Study 
U-iject Idcnti f icat lop Study 



Percy b, Peckhan 
Posit tor * 



/snlstont Professor, rducational Psychology, Faculty of Education, 
Orifvcralty of Washington 

Teacli tnp. Aas i^nnout 1969 - '/O 

Measure pent anti Evaluation (undergraduate) 
basic Educational Statistics 
Pet;eardi Methods 
Computer Ctilization 

Research Design and Analysis ' 

Sufnnary of V rofo ssi on a 1 Tlw 1969- 70 



Teadiing 


6 7% 


Other Adminls L rati rn 


OX 


Fuse arch 


33% 


Other 


OX 


lUisearcfi Adrritiipt ration 


{'7 











b.') 



Pub II CM I i ona 



*'Kevlew ol Unders t«ind lnp^ Kducatlonal Research by J>, Van Dalen“ 

(with Kennedi L>, Hopkins) » Educational nd Psy diological Heaaurenent, 
539-5/1I, Summer 1967. 

*'An InvestI ion of the I'ffect of Non-Ilomor,eneity of Re^iression 
iMopes Upon Che F~Tost of Analysis of Covariance Research Paper 
Uo» lu , Laboratory of Kducacional Researcli, University of Colorado, 
Sopterijcr 1968. 

’‘Review of Sax’s Empirical Foundations of Lducational Research ,** 

Lducati oua I and l^eycholoplcal Measurenent, 5^^ - 5A6 , 1969 , 

“'llie Experimental Unit in Statistical Analysis; Comparative Experli^ent 3 
with Intact Croups,” (with Cene V Class and Kenneth D. IJopkins) 
l^sccvrd\ Paper No* 28 , Lfboratory of Educational Research, Boulder, 
Colorado, March, 1969, 

”'ihe lixperiment al Unit In Statistical Analysis,” Jo urna l of Specia l 
Education (in press). ~ 



Robert A, Smith 



Poai cion 



Assistant Professor, bchool of F.ducet.on, University of Southern 
Call f ornla 

lead! in p A ssl;:nr>cut 1969-" 70 

Introiluctory Statistics 
Intermediate Statistica 
Expe rlrxintal L>eslpn 
Computer Applications in Keseardi 

Summary of Profess tonal Time 3909-70 



rcachlnp. 




Other Administration 


0;. 


F43.se tjrdi 


li>7. 


('ther 


OX 


Research Administration 


107. 







Ulssercati on 



As Empirical /sna lysis of tive l.ffect of Cnecjual Sample Size otl the 
Tukey St ude^n tired Kaupe Tcchniriuc (Aupust, )96b) 

Pub 1 3 ca 1 1 on s 



Fripirical <\nalysls of the Effect of Unequal Sample Size on the 
Tukey Studontired Kongo Teclmlque,” R esearch Paper he, 18, Laboratory 
of KducDtlcnal KesearcUt University of Colorado, September 1956, 

Review of VHacoosln Con temp or ar y les t of Eler^cyTtar y MachOTatlcs , 
Journal of Eoucactonal Mea^urer^nt (Tn priaaTT ~ 







•*tom|>ul:cr Trocetlurc for tlio Malyais of Varlaaco in niree-Factor 
Kxpcrlnient with KepcatcU In iHio of the Three Factors,'^ 

(witl> Vounp, li, \jee no'l k7illlani K* Mf chael) Educatio nal and Pay choloplcal 
y ;;iaiirericnt , 29 » 715-716, Autumn 1969* 

”Feview of Horst’s Psychological Measureirent and Prediction, Psycho- 
lactrika , 22, 355-356, 1967. 

Fob car ch in I’ r op res s 

15cvicv of ]£^ Sinulatl on du Comp nr tc rr.cn t Humaln ( The Sirrulatlon of 
ilunan Ue!iavior ) for Educational and Psy cholopl ca 1 .''cais ureren t 

The Effect of Unequal Croup Sizes on Tukey’s USD Procedure (under 
consideration hy Pay cuone t rika ) , 

Nep.otiotion Attitude Inventory - a revised instrument being developed 
(in conjunction with l>r. Frank lax, Educational Psvcnolo;^ Departrr^snt 
of University of Southern California) for the California Teachera 
Asnoci ation-Southem Section* 

Achlevcrrient Prediction of Studrnts in an extended MatherAtic Sequence- 
a nroject fi^nded by the State of California In conjunctlcu with Dr- 
PauJ \fliite of Mathematics IVipar trent , University of Southerr> California* 



Arthur i* White 



Post ti on 



Assl-jtant Professor, Science and Mathematics lJepartrr«nt , Faculty 
of Education, O^lo State University 

Teadiing Assignment 1969- 70 

Practicum for Methods of Teaching the Physical Sciences In Sccondaiv 
Schools 

Supervision of Student Tea die rs 



Summary of Professional Tim e i9b9-7Q 



Tcndiing 


25% 


Other 


Administration 


0% 


Fcsearch 


bX 


Other 


1, Advising 


15% 


ycosoarch Administration 


OX 




2. Student Teacher 





Supervision 50% 

3, Currlculun h’ork 5% 



UocC urnl Utssertotion 

The Development of Models to Explain the Relation of Important 
Variablea to Uaboratory Strategies (Ausust 1969) 

Pusonrch In Progress 

Problcr; booklet to accompany tails Lies text by (Icnc V. Glasj 
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vn • ] quo rush rps , Draining Kxpcrlfaecs , and ServicGs of the 

A# Stf rvl cea of lUc LlK 

llie Laboratory of Lducntional HescarcU serves agencies and cr gnnlzfttions 
outRlile of tlie University of Colorado as well as within It# Service 
takes the form oC Internship activity (UiR Vellot/s working on researcli 
projects with an educational agency wltliout remuneration) and consultation 
on matters of rcaearcli design » finaly.sis, and evaluation* The following 
agencies and projects outside of the University of Colorado were served 
during the 196B-09 acaderlc year, Several internships were Involved in 
evaluating Title 1 and 111 projects. 

1, dlological Sciences Curriculum Study 

2, Coldca Uubllc Scliools (Colden» Colorado) 

1, Coi^orado Springs Sciiool District (Colorado Springs, Colo,) 

A, Louisville High School (Louisville, Colorado) 

3, Inrtli Science Curriculum Project 

0. Colorado State Department of f'ducatlon 

7, Social Science education Consortium 

8, Clearing liouae (Boulder, Colorado) 

D, Nebraska State Departrent of Education 
10# Boulder VaJlcv (Colorado) Vocational Education Unit 
11, Sacred llcert High School (Doulder, Colorado) 

I2# ^'cClclland foundation (Pueblo, Colorado) 

n, UeparCment of Speech Uatliology (f)ueens Collere, Hew York) 

1^. Deportr^nt of educational raychology (Tenple University) 

V*). Human I'actors Ucseardi Lab, (Colo. State University, ?ort Collins) 
16. tlortlig.lcnn Junior High School (iXjuver, Colorado) 

J7, Bureau ol Lducotlt\ial P.oHe^rcli (Denver University) 

Id, Ivnver >'et f opal i tan YHCA 
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19. 


I'-l i*a30 School District (Colorado Springs) 


20. 


Law Sdiool (Denver University) 


21. 


Scl\ool of Education (Duckneil University) 


22. 


Scliool of Education (;Jripi\am Younja Unlvexaity) 


2J. 


American Uducatlonil Researcli ^jssociatlon Post-Session on 
experimental design analysis 


ihe 


follou’ing departments and units within the Inlversity of Colorad 



ustid tJ.e ser\;lces of i.KF for consultation on research deslpn and analysis 
'Hie number in parentheses is the nuniier of individuals In that department 
who ussd the services. 



1. 


Sclkool of liducatlon (90; 75 students, 15 faculty) 


2, 


Departrent of I’hyalcal Education (2 7) 


3. 


School of Business (13) 




l>opnrtment of Psychology (5; 2 students, 3 faculty) 




Departrrenc of Speech (6) 
IX^p.'iitmenC of Economics (2) 


7. 


U’part ment of Anthropol ogy ( 1) 


b. 


Department of Pine Arts (1) 


9. 


School of Nursing (1) 


10. 


Department of Audiology (1) 


11. 


(enter for Study of Intellective Behavior (1) 


J2. 


JIniversity of Coloralo Personnel Services (A) 


IJ. 


UniverslLy of Colorado Counseling Center 


u. 


University of (Colorado Uorrrltory Study 




Institute for Vichavloral Science 


10. 


Dor \ln ilbrary 


17. 


University of Colorado Mi^dlcal School (Denver) 



Data f.athered pertaining to the role and services of the L£K 

QR viewed by other faculty merhera Jn tlie School of EducatioHi A questionnaire 
was distributed to 41 faculty monibers of the Sdiool of Ldvication; 28 
of the questionnaires were returned in usable forin> 21 fron^ faculty on 
the 8oul(ier Campus and 7 from the Denver Center# A majority of the 
non- respondents ere likely to be individuals who had not utilized the 
JJ,f and prol)ably did not feci qualified to respond or the basis of a 
lack of adequate tnfornetlon. Ouestlon No. 1 supports this view since 
twelve respondents reported personal use of the lab, while 13 is the 
total uunber of users appearinj> on records. Certain]*/ one should 
view the 28 respondents as not necessarily representative of the non- 
respondents# Vhc qucLtionuaire and responses are shcA/n below. 

tionnal re on the 

L:tb oratory of Cduca tlonal research 

We are gatlierinp, information to evaluate the opcra'loris of the 
Lih oratory of Educational Rescardi during the 1968-1S»69 academic year 
(including siirmcr sessions) and in order to plan for che current year. 

Your rcHponses to tlie foll<>/ing questions will be appreciated# If you 
are nev/ on the faculty, undoubtedly ^ ou ^ill not be able to respond 
to these questions. When you have completed this questionnaire, please 
return it unsi;;ned to the mailbox of Dlainc Worthen, 

lhank ;'ou. 

Have you personally used the services or facilities of the 
Laboratory of Educational H^search (l£R)? 

Ycfl Boulder 9 Denver 3 Total 12 

No Boulder 11 Denver 4 Total 13 

If ’*Ycs,** often? 

I tlnv; 2, 3, 3, 4, 10 tires; very often, once every two weeks. 

11 **y^'S for what purpose or in what manner? 

"Data processing; stalistlcal advlsinr; copiputcr usape; 
consultation on researerh.” 
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a. How mar.y of your advisees used the services or facilities of LER? 



liou Ider 


Denver 


Total 


Number 


Faculty 


.Su^nber Fa^'u 


Icy Number 


Faculty 


0 


2 


0 3 


0 


5 


1 




3 1 


1 




2 


6 


5 1 


2 


b 


3 


2 




3 


3 


4 


1 




A 


1 


f) 


3 




5 


1 


12 


1 




6 


3 


Several” 


1 




12 

"Several” 


1 

1 



b* If one or tr.ore of your advisees did use LEk cervices, In what 
n^nner or for wUat purpose vcrc they used? 

’’bc3ii;n of L-cjcarch; computer ui;oe,ej atatistlcol conaultation ; 
evaluation tJenlgn consultation ,*’ 

a. hid you attend any special presentations or i.iec tings arranged 
and conducted by U'.K during the 1968-1969 acaderrdc veai ? 

Ves lioulder 3 Denver 1 Total A 

i'io Boulder 17 Denver 5 Total 22 

1), If approximately licx/ many? 

1; or no respouBc 

Do yea feci that the activities and objectives of lXf‘. are helping 
to ineot the researdi needs of the School of education as Identified 
In tiie report of tlie Ad Hoc Committee on Research, Measureracnt , 
and Statl'itlcc and the School of Education Self-Study? 



Yes 


Boulder 


17 


Denver 6 


Total 


23 


Ho 


Boulder 


1 


Denver 1 


Total 


2 



’Ihe U.F trainees for the period 


Indicated were as folloi/s 


(Jlenn Bracht 


Steplicn Jurs 


Daniel Bauman 


Kobert Hendro 


Hnncy Burton 


Jon !torrls 


Jamos r.olllnn 


Hasahlto Okada 


f>cott linrrlngton 


James Sanders 


Ralph lUkatian 


Arthur l-Bilte 



Rloase Indicate Strong Agreement (SA) , Agreement (A), Indeclslcn {?), 
Dl«/»j:reetneut (U) , or Stroup Dlnakrecmcnt (SD) to each of the follcwlng 
jtptements ns tliey apply to tlie above I£R trainees. (If you know 
nono of those students, orlt Koc. 5-8.) 
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'Jlioy seen uot to have an adequate 


SA 


A 


7 


D 


SU 






Interest In eciucatlon, 


2 


1 


1 


7 


6 


Boulder 






1 


0 


0 


0 


2 


Denver 






3 


1 


i 


7 


8 


Total 


6. 


’Hie do not seem to be wlllinf, to plve 


SA 


A 


? 


D 


SD 






assistance to other p.radunte students 


0 


0 


3 


6 


8 


Boulder 




on research and evaluation problems 


0 


0 


0 


0 


2 


Denver 




' 


0 


0 


3 


6 


10 


lot a 1 


7. 


Ihcy are primarily Interested In 


SA 


A 


? 


D 


SD 






statlatlcs (as opposed to cestlnpp 


2 


3 


7 


4 


1 


Boulder 




educ, psydi. , counseling;, math, educ. 


P 0 


0 


0 


1 


1 


Denver 




etc*) 


2 


3 


7 


5 


2 


Total 


8. 


They seem to have tiie qualities 


SA 


A 


? 


D 


SD 






noodod to be effective os 


3 


9 


3 


0 


0 


Boulder 




a. university proleaaors 


2 


0 


0 


0 


0 


Denver 






3 


9 


3 


0 


0 


Total 




b. public school research workers 


3 


8 


3 


0 


0 


Bou Ider 






2 


0 


0 


0 


0 


Denver 






5 


8 


3 


0 


0 


Total 


ricose Luirk either SAp Ap ?, D, or SD for 


eadt of 


the 


follcwing 


statements 


ajx 


tlicy pertain to the cperdtlons of Uik. 
















IXK should tutor Education graduate 


SA 


A 


7 


D 


SD 






studentn having difficulty in 


1 


7 




7 


1 


Boulder 




statistics courses 


2 


2 


0 


2 


0 


Denver 






3 


9 


A 


9 


1 


Total 


JO. 


LLk liori been successful In Improving 
the quality of rescard^ perforned in 
School of Education 


the 














a, by graduate students 


6 


11 


2 


1 


0 


Boulder 






3 


1 


3 


0 


0 


Denver 






9 


12 


3 


I 


0 


Total 




b, by faculty 


3 


ti 


7 


2 


0 


Boulder 






1 


2 


1 


0 


1 


Denver 






q 


6 


8 


2 


1 


Total 



o 




lo 



11 



11. 


1>:R Is not l»elnp of service to tlie 


SA 


A 


? 


h 


SU 






public sdiools of Colorado 


0 


1 


13 


4 


0 


boulder 






0 


0 


6 


0 


2 


Denver 






0 


1 


17 


4 


2 


Total 


12. 


In training graduate students, LER is 


SA 


A 


? 


D 


SD 






placing too much emphasis on researcli 


1 


U 


9 


3 


2 


SoUlder 




and not enough on learning about other 


0 


0 


S 


2 


1 


Denver 




areas of education 


1 


6 


12 


5 


3 


Total 


13, 


If 1 had a question pertaining to 


SA 


t 


'I 


h 


SD 






researcli design, measurement, statistics 


, 0 


0 


2 


8 


11 


Boulder 




or computer use, I would be reluctant 
to consult UvK for assistance 


0 


0 


1 


1 


5 


Denver 






0 


0 


3 


9 


16 


Total 



16* riense wriys in which UiK could be of greater service to 

the research efforts of the entire School of tducaciem (including 
faculty, graduate etudcnte, etc,): 

Uouldcr: *^A brochure should be distributed explaining ^he services 

of IXR." 

"livery report from itiy students about IX B. has been favorable. 
Keep up the good work," 

'’Limit outside state work and paid consultancies and 
earn salaries here first,*' 

"I liad the feeling that LER was primarily concerned about 
the eduesCioa of research specialists and not about assisting 
others In doing researdi." 

"‘fhe staff and fellows ere doing sunerlor work," 

**LLR has done much to raise the stature of the School 
of Education," 

"Tlic faculty Is outstanding! perhaps the finest of its 
kind in the notion." 

"1 c(x\aider it to be indiepenslble , the beat addition to 
the School since 1 have been here*" 

"1 consider the IXR a fine 0S3et to the Sdiool of Education 
and pledge iny support of Its activities," 

"What is the UiU?" 

"If tiic I'uculty were doing more research, you could be 
more helpful. As it Is! I an not sure what can be done," 

lienvcr: *'l doi'i'i think . .ire’s a better one In the country," 

"Aj'i orientation on iER fold its capabilities for faculty 
and graduate students in Education at Denver and Colorado 
Springs would be helpful," 



Ihe data above indicate tliat wni le the LLK is utilized by only 
approx! mac e 1y 35 per cent of the faculty thenaelvcs, over 50 oer cent 
have Adviccea who have used L£E services. In addition, approxievite ly 



Ht) )»cr cent of the respondents feel that tlie LER is hclpinf. to n^et 
tn’|u»rl.inL rescuirch needs of the School of Education, L>‘R Fellov/s are 
viewed as willing lo hcl)>, interested in the field of education^ and 
ptbisesslnr qualities nece.ssarv to be effective university professors 
or public sdiool research workers. It sectns that a nunber of respondents 
are not cotnpletely a^vare of the role and services of tJie LEH and an effort 
sliould be made to comrrunicate these more effectively the School of 
Education faculty, Ihls Is partlcularlv tiue of respondenta fron the 
i)enver Center, wijerc dlstr'mce is an Ippedinj;; factor both in Interfereing 
ultli conimuni ca t Lon «ind llrltin{> access to the LER facilities. This problem 
should be ameliorated at least in part by tlie addition of a new faculty 
rx‘ni>>ir, Ulaino R» Wortl\an, to serve in a dual role as coordinator of 
research at the Denver Center and Co-Director of the LEE, 

The post active and sipnificant aspect of LEP’s service to the 
University ts tlic assistance it extends to graduate students parforming 
research for advanced degrees, A total of 1,492 r.an-hoors of free 
conHultlnj* was provided to graduate students through LKH. A total of 
7bt> of these hours, slightly over half, were spent with the graduate 
.students of the School of Education, There were 473 ran-hours of service 
provided to faculty rcroere of tiic University (outside of lEF) , la 
a<!dltlon, U!K Eel lows apenc 445 ran-hours working vritli IXR directors 
On rencarcli projects In which they were engaged, (All figures are for 
t rninec.i only and do not Include contributions of the lER direct ora.) 

As sUa/n below, the mean nurrher of Internship hours was 495 for the 
total p.roup with a range fcon 270 to 892 hours. 




iw3^( 

v,i 
/ / 



Student 



Hours 



1 

2 * 59/4 

3 ** 31)6 

A A77 

5 A06 

0 * 

7 396 

B A87 

9 < 520 

10 270 

J1 568 

12 478 

^rotal hoars not available for this Fellow 
*NI)liA Follcwa 

**Rc9oardi Assistant « University of Colorado 

Approximately 5»445 tnan-Uoura of practical experiences were lodged 
by the Lblt Fellows in research activities • Ihese activities were categorized 



Into acvan divisions as follou^s: 

Activity Percent 

l^rdjlcTT Development 17 

lU!8carci\ 11 

Statistical Analysis 26 

Measurement and Instrument Development 10 

Hxperit«ntatl on 4 

Writing; proposals* rcporCs« ctCi 8 

Cot?puter Utilization 24 
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'llic Irttornalilp activity t^roakdovn followed a rather similar division 
for all Icllows, 

At the request of the !£K 01 rectors ^ three persons under whose 
supervision internships were served durlnp 196R-69, recorded their 
Ip^presslona and evaluations of the experience* Tlielr letters are 
reproduced on the folla^lnp pa^cs* 
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EARTH SCIENCE CURRICULUM PROJECT 

H P.O aO> IS59 BOULOeR, COLORADO 80302 TE L E PHO NE (303) 4 47-8100 

Oclobcr 15, 1969 



Dr. Kenneth D. Hopkins, Director 
Laboratory of Educational Research 
McKenna Hall, University of Colorado 
Boulder, Colorado 80302 

Dear Or, Hopkins: 

With this letter, ws are expressing our complete satisfaction with the coopera- 
tion we have and are receiving from the staff and interns in tne Laboratory of 
E<^ucational Research (LEft) at the University of Colorado. 

The interns who have worked with us on the research problems have been most 
conpetent. Although they were not always familiar with the subject of earth 
science, they were able to offer meaningful suggestions to us. They were 
very practical in their outlook and quite honest in their recommendations. 

When we presented a problem with which they wer*' not familiar, they searched 
oiU the necessary literature and met with us at a later date with appropriate 
information. Although we have received the services of several of your 
interns, wc would like to commend especially Mr. Oanie^ Bauman and Mr. 

Jaynes Sanders for their counsel during the past year. Both have exenpl i f led 
a professional research and evaluation competence that reflects highly the 
program of the Laboratory of Educational Research, We would be pleased to 
have either or both as professional staff members of our Project. 

The specific services rendered by the LER included an analysis of data 
gathering In preparation for a research study, use of a Stake Model for 
establishing a data matrix, assistance in the establishment of several 
evaluation instruments for use in a national in-service institute study 
w/c are conducting for the National Science Foundation, numerous computer 
prograus for data processing, Campbell 6 Stanley research designs for 
severa! studies conducted and being conducted by our Project, and LER staif 
and intern analysis of our instruments and designs. The interns have also 
rccomrtci'dcd severa’ and studies from the literature which have been 

helpful in cur planning. 

Ftic quality of the work frcHi the persons in the LFR has been of such high 
quality that wo are building Into our future proposals specific provisions 
for cooperation with the LER. Both tiie inner-city Environmental Studies 
Program proposal and the pre-servicc Teacher Preparation proposal currently 
under review by the National Science Foundation have provisions for research 
ossoclatns wh<i would v/ork with the interns in the LER to continue our 
research efforts. Our research associates would have u-xperMse In eerth 
science education and on interest in research. Tnoy wculd work with the 
LER Interns in conducting our research program. Our Toucher Preparetii- 
proposal also includes provision for cooperation with ERIC in our pro/' 1 j 
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2«Dr. Kennelh 0, Hopkins 



a clearinghouse of research in ejrth science education, from both the 
standpoints of reviewing research and the stimulation of research. We hope 
lo have the assistance of the interns fran the LER to help us with this, 
as il is appropriate to the program of the LER, 

The interest and action in the area of research and eva’jatlon of our project 
during the last year and a half is the direct result of contact and interaction 
wi(h the professional staff of the LER and the interns. Prior .o that we 
viewed with suspicion most educational research. The practical, honest, and 
meaningful interact ions wilh the l.£R personnel have changed our views and 
given us a new insight into rcsoarcii in which we should be involved. 

There is one thing that might help us as a potential user of the services 
of the Laboratory of Educational Research. This would be some sort of 
publication that would indicate those areas of services In which the LER 
is interested. For exaaiple, we are in need of a great deal of assistance 
in the area of evaluation and research in the Affective Domain. Is the 
LER interested in providing *^uch assistance? If so, to what extent? Do 
any of your Interns have an area of interest to them personally that we 
might capitalize upon in relation to our needs? Information such as this 
would be helpful tc us. 

Our prnjict feels very fortunate to be geographically close to your LER. We 
hope that our research needs have provided some meaningfu) experiences for 
your interns and that oi>r cooperation rua'/ be expanded in the months and 
years ahead. 

S I ncorc 1 y yours , 



V/ i n i am 0 . Rckhc ^ 
D i I e< l 

WDR/pd 



8i 



ry or coi orado 



I t.'i Mo.u'),* 



HCilticii nr » |< >N 



October 24, 1969 



Dr. Kenneth Kopklna , Director 
Laboratory of Educational Kesearch 
School of Education 

Dear Ken: 

During the peat year I conducted ar- -nterlm evaluation 
of the Cherry Creek Teacher Educati 'n Project In which ve 
attempted to aecure reactions of teachers* student teachers 
and university teacher education personnel to a cooperative 
teacher education venture Involving the Cherry Creek Schoola 
and the University of Colorado » In conducting this work, 

I had assistance from the Laboratory of Educational Research 
fellows and especlall/ a ^reat deal of help from Dan Bauman. 
He helped In the productl on of our Instrustents and In the 
compilation of the data. His assistance In the use of the 
computer was Invaluable. 

I also wish to express my appreciation for the help the 
laboratory has given our graduate students In Improving 
thalr research designs and In the processing of data. We, 
as a School of Education, are Indeed Indebted to you for the 
services which you have rendered. 



Cordially yopra , 




Harold M. 
Professor 



/y/ 

Andevsoh 
of Education 



:sf 
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UNIVERSITY or COLORADO 



OO'-JLOER. COLOHAOO 0OoO2 



October 2^, 1969 



Director 

Laboratory of LducaC^onal Research 
School of Educa?’Lon 
University of Colorado 
Boulder^ Colorado 80302 

Dear Dr . Hopkins : 

This letter is to commend the faculty, staff and students of 
the laboratory for tiieir cooperation in working with me on a study 
on which I am project director. The study deals with an evaluation 
of a "Model for Planned Changes in Elementary and Secondary Education^' 
which Is being conducted by the Cherry Creek School District and 
funded by the CfMrles F. Kettering Foundation. 

The graduate stuJonLs from the laboratory have had excellent 
training in that their services to this project have been extremely 
helpful. The faculty has provided time and advice which is deeply 
appreciated. The irosL Inporiant aspect of this working relationship 
Is that the evaluation, in Itself, will be a more valid and relevant 
report because of the help of LER fellows and staff. This in turn 
should help the school district In making norc meanlngf JL decision 
in future educational prograins. 



Sincerely 




Michael Kalk 
Associate Professor in 
Educational Psychology. 



It ttiiould lilac be noted that trainee respenj^es to an Item In 
ijuDs tl emnai re IS reveal that UiW perceive clients aa : 

(a) In need of the fie Ip they request, (b) receiving benefit from that 
iielp, mul (c) grateful for such assistance. 

10. Concept; IJiU Clients (Students and Faculty Served by U.R) 

12 3^567 



Well Frapared 0 0 4 0 3 3 0 

'ihey benefit 3 7 2 U 0 0 0 

Ungrateful 0 0 0 1 J 6 4 



Poorly Prepared 
'fhey bon't Benefit 
Gratefu 1 



b. Internship Cxperj q ncea 

Several Items in Questionnaires A and 3 were used to obtain 
from the Fella;s their opinions concerning the value of the internship 
program and to Identify lha ingredients of a pood internship experience* 



Ihc tphul.itcd rusuiLa appear belo^’. 



S trcmgly 
Agree 

1 2 



Strong ly 
Disagree 
4 5 



lb, T.ic Intomshin csqjcriorices outside of 
tl e university were vtry valuable 

17, loo much internship tiiua is required for 
I'Vetinp the relevant objectives 

F>. 1 resented having to assist graduate 

students with their course, work 

Cnncopi : Interns I lip !hipervislon 

1 2 3 4 j C > 



Too Closely nupeivir,cd 0 
\ssi fnirtmts Ciora' 1 
Insufficient iir*e ,j 
Clven for VasKs 



\2, Ccnccpt; Internship 

Valuab Ic 
loo Much 
Conducive to 
l);*UviduA) Kosearen 
Kssentlal 



0 3 3 4 0 h'ot I-nou^h Supervision 

3 0 2 0 1 /kssiwirents Unclear 

1 2 3 2 3 Cnougli Time Given for laaks 



2 1 2 0 0 Worthless 

2 6 0 1 0 Too Little 

Not Conducive to 
Individual rcsearclr 
1 0 2 1 0 Not ts sen tin. I 
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11. The list l>olov some or t!iO kinds of .irt ) vi 1 1 cs and tasks t?Mi 

Fellows perforrr as their iritemshlp duties . Please respor. 

to each^ Item iri tSie list la tl\e j^£o ways listed !<olow: 



UP^ 

Chock frequency of 
occurrence for each 
activity 



Sr.eONT) 

n\cck ajiproprlHte value* voj attach to eac)? task, 
wlK’ther or not you were v-alled upon to perform It. 



Often 


Sometimes 


Seldom 


Never 


i 

2_ 


3 




7. 


1 n 




y 


— — ■* — - 
10 


- JL_ 


1 


0 


Q 


li— 




_ n _ 


1 ; 


~XL_ 


-- 1 


1 


R 


— 




fi 


1 


0 




\ 


11 


^ OL, 


- 5 


7 


i 




1 




u 




L_ i 


_.o 


2 






s 


7 


-_5L._ 


A 


4 


0 


. SL 


_5_ 


6 


1 


. 1 





4 


ft 


L.jiJ 


z__ 




n 


i 




S , 


n 


L- Q_.. 




. r> 


1 


1 -Ji 


A, , 


V* 




r 

\-..A 

l—'i-.J 


1 ^ 




j 




. _4 


L 


-i'-J 









r 

( — 1 — 


i J 






s 


; <) 






6 


L , 2._4 


^ f 1 


! 1 


L.jo ; 


L 


4 ^ ^ 




' c_l 


Q_ , . 




ft 




8 




n 






^ 


7 




-jC 


A 


1 


L-i ^ 


a___. 


1 


1 


C - ^ - 


1 


0 


0 


i ^ 






0 


C.i 


-4^ 




1 




1 




_i — 





i.-_Q 


-S 




- 4 


La__ 


3 


_2 


*> 


! 

-.Ji 


SIq ... 


--/? 1 

if . J 


— 

izi\ 

\-or 1 

i 


* i 




it 


-L-:l 


Often 1 



Some itnos 
L 


i 

SoMo..f j 



er|c 



Lrd Student JJ'.P Dlsrussion (urown Sack, 

Lipecial oeir-lnar) ^ 

Helped v;lth research budgets 

Assisted In administrative duties 

Took minutes In meatlngs 

Planned ana arranged semtnarfl or? 

Attended professional meotlriga . . * 

Assisted with suporvlscr's prolesstonal correspondence. . 

Helpod draft Or edit supervisor's publications 

Filled out q jestlonn^lros for supervisor received from 
out.''. i«U' of i.n'.i. 

Designed a research study 

Reviewed and/cr abstracted literature on a topic 

Conccptaallzed a research problem 

Assisted In other concoolual activities [ . ] 

Wrote a research proposal » . 

Designed statistical analysis !..!!! 

Wrote computer programs 

Concucted Experiments . 

Constructed research Instruments 

Admlnlstorod or scored research Instruments 

Collected data in other ways 

AsslLted In ectuni teaching of courses 

Resd Or graded papers 

Adminlsterod or scored classroom exams 

Assisted In preparing lectures or speeches for supervisor . 

Dh* typing, filing, bnd/or ariswcring telephones 

Did collating, duplicating, tallying, and/or bookkeeping . 

lisod calculMcr for data analysis 

Made tables, graphs, or charts 

Cc-do<i and/or tabulated data ] , . 

Keypunched arid/or verified data ' ! 

Submitted data (or computer analysis 

Used other comp Jlor- related equipment 

Irtofprelod data . 

Helped wrlle up final research ropNirx 

Wrote researe.h article 

a research 

Sr jp physical facilities fer conferercc s or lectures , . . 

Asslstoa iuv>crvlsoi wUr personal mutteis . 

Lfiga in fno:iual lotox (moving fuinttur?/ etc.) . . . , , 
C.ofherod dila icr thesis or dlsserltitlon 
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In ^»encra\» I’ellows expressed the opinion that the Internship 

cxpcriencea are essential and valuable* Unlike previous years ^ there 
was no strong opinion that the internship required too iruch time. A 
desire (or more supervision while allowinp for In volvainen t in more Individual 
research was expressed. Constructive steps have been taken to facilitate 
this desire, 

[here Is a continued feelini^ that the Internship experiences outside 
of the university are of a questionable value. It ir.ay prove necessary 
in the future to be more selective in the kinds of projects and agencies 
with which Intcmshlv's are arranged to insure their v^ilue to the trainees, 

Tl\e Kellw/s indicated the follcr/ing internship activles were of 
creates c vaJue: 

a, research related acLivitiesj including 

1, coticeptualLzatlon of a research problem 

2, design of research studies 

J, design and interpretation of statistical analysis, 
including computer utilization 

A, writing and reporting cocipletcd research 

3« attendance at professional r^etlngs 
bj Hsr.istinp In instruction of courses, including 

1, rcLual ^caching 

2, roadinp and p,radlnp of papers 

Ihc frequency of occurrence for each of the above activities indicated 
that In general, tiicsc activities are iruch more prevalent than others. 

Conversely, the trainees indicated that their internship had provided 
tliem witlj little <«pportunlty to enpape In three actlvltl^is they viewed 
AS very valuable t (a) writing research proposals, (b) ^-Ivlnp research 
papers, Oii'J (c) conducting experirxintn , li^R directors ^■Grc alerted 



to (b) above through Informal feedback and steps have nJ ready been 
taken to provide this type cf experience* Ways of providing rore intem- 
slklp oppor tuuf t les In relation to (a) and (c) above should be studied* 

Two activities viewed as lUiVlnp, little or no value bv a majority 
of iy\( follows occurred wltiv sJOi^:e frequency* They were 5 Ca) codinp and/or 
tabulating data and (b) keypxuiciiinp and/or verifying data* kTille these 
arc eaccutlal coTpouents of the rasearch process, th'" e lata tn: ndlcate 

a lack of sufficient clerical support for the volunv of data pi cessing 
which Is handled by Tellows as part of their internship experience* 
VcThapr. ways should be found tor those recelvlnp LfR services to provide 
clerical Ip Cor those activities. 

VIII* IDP. Ac /:lvltics 

To evaluate further the traininp prograrri, the iy6S-69 Fellows were 
asked Co respond to itemi; on Oucstionnai res A and 5 that elicited opinions 
about the prograiA ir, general, interaction among the Fellcws, effectiveness 
<'f int''a-i>JK comr uni cations and training sessions, LFk facilities, equipment, 
{Lfuairlr.J liupport, and profess 1 or.al memberships and reading preferences, 
labuliitod tti. ptoses to these iters and other expl^natcr>* data are included 
<n th<* sections that follow. In r^os C cases, the data are self-explanatory 
and ;U Intorpr^iiat I on io of( red. 
f^^nera j Koaotl ( u 

Strongly Strongly 

Agree Disagree 

1 2 3 U 5 



T. I dfd not lonm much nev during this 

period* 0 0 0 1 11 

6* 'ihr prorrar medc possll^le a degree 
oi re'.oard* cc';jpetencc cIkI would 
a;»t haw I'cen otherwise poss/iihle 

I o r iro , \) 7 ' T 1 

V. *hc I i* Ar ijAd Kttle cflect On 

o; .1 r radu’.ro .‘“{tuuciit i In Uu: 

Sr' ol of l.ductiticn 0)17 4 
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St rongly 
Agree 
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Strongly 
bis egrec 
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11. 


?V tifre was well spent. 
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'Jlie program me t my expectations. 
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Too TTudi time vas devoted to trivial 

matters , 
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The propram should have been more 
flexible to nvot Individual neeck. 
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15* Interaction amvnp Fcl lows 
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Oio pleuslbie explnnatioci for the apparently positive interaction 
is tliat Felle;y valued one anotlier to a degree, IViia interpret;,Cion 

is supported by date fro'n the tol leaving iten?, 

1. Co ncept ; LtR Fellavj 

1 1 2 j* A i 2 

Hrivht y ; 1 0 0 0 0 IXill 

Voorly ^’otivatod 0 0 0 0 0 7 5 Highly Motivated 

i'le/lbje 0 0 2 2 0 1 1 Inflexible 

Anbltinus C h / 0 0 0 0 Lazy 

Younj; 2 3 3 1 1 0 0 Old 



Lj \if le e t i vGnos a <2 lnt rn~ lab Ccjp.rtiuntcai i cv is end 1 raining Sessi ons 
l>uring the piijt yoti three protnlnent persons frorr the field 
of education visited the University o( Color<jdo and provld^sd oenloor 
experiences for the LLK Vellos^s, 'Jhese throe were Dr. jci:n h. blgiG 
cl tlie Kflucntionnl Lcoearcli Un^^. of Inive ro ! t y , tiryto'^ ^'.'ctoriu, 

Auatia'l,'; Or. r*r.yiri-nd d» CatCoi'. ol the University of 'llinols, and 
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Dr, Julian Stanley oi Johns Hopkins Ifniversity, The latter two were 
personally Invited by the JLrect^'rr; intornctod formally and 

Informally with tlto Kellcws, 'he Fellows indicated cn a questionnaire 

Item tlidt they found these seminar speakers interescinp and the experience 
beneficial, liw^ever, they also felt tliat these sendnars did not occur 
often enougti, 

, Concept ; ouminar Speakers (From otiicr school^ r ^.tpiises, etc.) 

2 2 1 2 

Ton Often 0 0 2 7 I 2 Not Often Enough 

Interesting 3 1 b 3 0 0 0 Uninteresting 

Hcncftclal J 2 700 00 Not Beneficial 

The HlR also schedules nestings and seminar situations at which 

tne LLK directors and fellws proscut informal t’iscujslotxs on various 

topics. In the past year three Fellows presented the papers which thev 

VC re X'itzc to present at tae ^\FRA Convention, Also, Ur, Glass and Ralph 

(lakfitisn (a Iclltyv) presented a series of aclieduled lectures on nrulti- 

varlat'i iinelyaln. At the directors and Fcllcws present for discussion 

at the schei1uL\t week ly sei iiaara discuss any topics <x\ which they are 

presently v/orking, incluainy dlsscrtaticn work. In the l.-ist year, the 

Koiiws spent a total of approximately 450 hours in seTiilnars and similar 

rrf’r ti r gs , 

auHic tonj r,itvrt heen nadt to Infoi'n Feilove of new concepts, 

devt J oprjen t i , an<j tc. cj.n I; re search and re^jearcl.-rclated areas 

by ro.' tin; rilovruU rater In in lo all iellova In tne IF:K. Iho Fellows 

route rraterialn V.of bnlieve to bi of interest to other LER personnel. 
In tULa Miechnlqu*. is 11 received; herwever, one con!*eot 

.*>bout Jfljr of Melectivtty in vn., t \>K^3 cocti'd stirrulated the follc/win;> 

1 tern. 
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Stron^cly 

Acree 
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Stror.j;ly 

Dlraf;ree 
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18. I was aakfid to read too many 

Irrelevant books and papers which 
are circulated through the Lab* 
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bvidr^utlv, I. he routin;: eysteir^ is viewed by the trainees as Ueflitable. 

J£ii bquip rreat. 

Al ^*>r<?soot (OcCobec 190 kOxiniate ly llSu squaxe feet in 
the baseirent of HclU ^kna bui3.ciric is uAec^l to ho-iae 1£K. Of this > three 
hundred aid ility square teeC coi.to^ns;. the offices ct hrs . Hopkins » 

01ni<3, and Vo:?^thea, A *r?r;^e 730 8qu,wc foot room is rded by the secretarv 
And the twelve interna, ajid IbO square fci‘t contains;' tne laboratory 
equlprienc in ivi ad;cini»v^: v'oo'n, 

i ''tch of tlio twelve hrjs a leak, filinir, cabinet sp.^.ce, and 

Available b*H»l; nnelf Mpace^ 3he secretary has a desk ,md several fiiiny 
and sioiMpe cabin*?ts. In riJ^lrlon, the labor ac orv ’ o library mierialy 
iuul vvo Lab) erf o»?allahij Tov conferences with clients are housed wiitiin 
this c^ncrcl loom* i'le pros.-nt airan^ement if. disruptive of study vher.ever 
co'i.HU 1 C. otio"'i with a cllcn:: cakes The noise rnC siocc factors 

Tra"Ke Ir dl?f\cuvt Co cor,:nlt. v;lth rove than one client at o tine. 

Va- Ud: virf :: a 1 cu in t o; s and rvo typewriters, ct/jc 

““I'r tacln I use u: < ; v ^'or the lutcrna. A bevp’ ,\:h 'ec.ina. 

<1 3.! ii); j»:r o\c r '.jttM, y the ).’;x 'ihis year, hit: ’>.H 'r.a;i ijcen allotted 
^ iy lUv Sclu^oJ of l.decncl ni f «. r corpucer lIpo, 

th-vaiai Itorfs , ccntHliijJ *n tl onnai rt , c lid tec tr^iipeu response 

relnr<*,: ».(> adc ’incv of lacilit/c-s, o-hjI prro.jt , 

I obu \a 1 1 ..’fis oi irf.e xc sponscj appeal oelr«v. 

V, si. 
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v^roi.o.i: facilities viii <uf. ailo’ ai: ex:) cast on 
f l f Lf' TT-fTf tU; .1 II 5^ .jrefcrjC of twelve :*’ejiws lentatlvi: 

y <«a-; t 't I S.’MncI of l.viv.cit iou Uu', ."iHot roi‘ i rate iy 3,0 jU ;cuaro 

ii.j*. ' M. -ja iyia. la tiir laCerln r.f-ric.i, the h'.H Is tenant i.voiy sclct*uie^' 

!c i. r * 'jcri.jsy tor.K; li, Sf.jaacc iteL in i i*. . ^rr.ool 
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t!")* ')T - ’-Wi, ^ro.^^':iwC fate. Oave j orients ’.^V. i ch jeoprr ilze the p Ir:.*' 
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Irt addition, Fellws receive J?5U0 annually for each dependent* 

Fellows' percepticnb of the adequacy ci this level of financiaJ 
support was yielded by an item troni Questionnaire B* 

6, Concept ; Fellowship Stipends 

2^34562 

Too Little 0 2 3 7 0 0 0 Too Much 

Fair 4 1 4 2 1 0 0 Lnfair 

Funds from LER paid consultinp activities are aLso used to help 

support Fellows' professional activities by paying fort (a) travel 

tcj iirportant professional conventions (generally AERA) , and (b) memberships 

In AKRA (including A£HA journals) and NCMi: (including the Jo urnal of 

Educational MeasureFiC n t ) , Feilo'/js perceptions of the adequacy of such 

funds are tabulated below, 

7, (ion cep t : Financial Support (Professional 

tc conventions; 

] 2 A £ A i I 

Too Little 1 3 5 i 0 0 0 

Kai r 3 2 2 3 2 1) 0 

r, Fr ofessio;\al 2ct ivlt les of F c I Icf vs 

s data on professional activities of LLK Fellows were 
collected LtirouK'ii use of two ite^s in f nes t ionnai re B. Specifically, 
tr/)it\ees were asked to Indir^te ’ r'f-rhor ships in Professional a.sa ocl ations 
and pr.'iennices In readinr profe-^:^ . >nal periodicals* The tabulated 
r e^>pr>nsi^s to these Iterif; 

12, M^r niw !^rof Ohs 1 ona J Ofiuc.itinn nr social science associations of 
s'iilcli v« .1 i*o .nx memJu’r durtn«‘ the academic year! 

\r't^rlc.ia Lducat i <'iial ‘’fsenreh Association (named 6 times) 
hoL'onaJ Council on oe.tsurcment in Education (nam^d 7 t lines) 

!'nl iv J I ^ ^.lppa (named twice) 

:-r.cion.il 7c^sociation of Research In Science leaching (named twice) 
‘ n rlcan I :>v cnologt ca I Association (named once) 

A:rf rtcan l'crs<r,ncl and (Outdance Association (named once) 
Association of Ccunstiur Lcucacors and Supervisors (named once) 
AKso' iaiion oi l'eoi?urerr.ent and Lvaloation in Oildance (named once) 



activities, e.g., travel 



loo Much 
Unf ai r 



13. Uifeck. tlie professional journals anci periodicals wtiich you read 
regular Iv : 

J‘^ requcncy 

10 Aroericaii )^ducatlonal Kesearcli Journal 
bioniet rics 

Biome t rika 

') Uducational and i’sy choloRi cal Measurement 

1 harvard Kducational F.eview 

Journal of Applied Psydiology 
Journal of H ducat ion 

H Journal of Educational Measurenxint 

J Journal of Kducationol I’sycholopy 

Journal of Kducational !<esearch 
Jounial of Experimental Education 
^ rhi Delta 

ray cholocical bulletin 
Psychological Fevicw 
i Psy chomet rika 

11 Kevltv of Kducationai Kesearch 
Teachers l‘o liege Record 

Others 

1 Kducational KoseardiCr 

1 Forum (EOH) 

1 Jcurna] of Research in Science Teadilng 

1 ACM 

1 Personnel and Guidance Association Journal 

1 Counselor IhPjcator and Supervisor Journal 

1 Association tor tiiasarement and Evaluation In Guidance 



1 X. Kesear ch 



U i< Fellows and staff purtuic an active nrograrr of funded and independent 
resi'jrcu, Vhc rcsearc)i of litiK lei lows was listed earlier In this report. 

The following list includes the publications and projects of LtK directors 
for 



kenneti. nop^ ins 



”lne ( cmKtdiitv ol Ve ri ii aad Nou-Veru nl IG; Grade One throuch Eleven'^ 

('. I th Gienn u. iiraclu). Paper ]>resented to the American Kducational 
Assoilaiicn^ Kos Angeles, February 5-8, 1969^ 10 pp, 
(^n■^^ra^L: i r.ickrnber>;, Vincent (ed,), AKFJV Paper Abstract , AKKA, 

pp. > » , I hj -' , 



'Vlv^'-ieac St.tiM r' j anr,uap,c .tin) , • on- Langu age IQs,^^ Feseardi Paper 

j.i'. c ! , Lahi*ratnrv ol i;dur at i i>na 1 Research, Inlversity of Colorado, 
I.jt..:; .. I'UiV (wi;li bibeiheln>cr) , 
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"The Kxpe rlTtienn al Lrat Statistical Analysis/' Researdi P aper No> 28 , 
Laboratory oi LUucational Ivescarch, University oC Colorado, March 
(with , L* I’ecWham and (I, V Class), 

"I'redl c tiiir ('rade i)nc KeaUiny, I’e r f orman re : Intelligence vs • Keadinp, 
Ucadlness Tests," Journal oi V>xper irviental Ldneation , 3 7 1 31-33, 
Spring J‘)o9 (wltli K, G, Sitkei), 

"Product Kvaluation of New Design for learning: A Junior high School 
Model, Year I," Laboratory of Educational Research, University 
of Colorado, mimeo, 31 pp, (with G. H. Bracht). 

"Miller's S ta tis tical Concepts and Applications , _A Non-nathenatlcal 

Explanation," review in Educational and Psy cholocri cal Measurement, 
221-223, 1^169 (with G. H. Bracht). 

"j<egression cind the Malchlnp fallacy in ^^uasi-Exper inental Research," 
Journal of Special Education (In press), 

"The Experimental Unit in Statistical Analysis," Journal of Special 
Education (with P. J.>. Peckhai^ and (L V Glass) (in press), 

"Multiple c:onpari3ons in Research: A /.esponse," Arne r 1 c an f ducati ona 1 
Research Journa 1 (with K. A, (hadbourn) (in press). 



tene V. Glass 



"Reflections on Bloom's 'icAvard a Theory of Testing whidi Includes 

Me asurement-Evaluat i on-Assessnen t , ' " Paper read at the Synposium 
on Problems In the Evaluation of Instruction, December 13-15 , 1967 , 
Los Anpeles, Calif., UCLA. (Also appears as Research Paper Mo. 8, 
Laboratory of Educational Research, University of Colorado, I^ecember 
1967, and as Occasional Paper No. 11, UCLA, Center for the Study 
of Evaluation, Sep tembe r , 1968. ) 

"Report of tiie American Educational Research Association 1968 Research 
Training Presessions Program," Julv 1968, 363 pp. 

Author ' 3 liul de and S ty le Manua I f or the Review of Educat I ona 1 Peso ar ch . 
Washington, U.C. : American i durational Research Association, August 
19 6 8 , 3 7 p p . 

"Measures of /ssoci.iiion In Cojni)ar at 1 ve i^xpei.’ ents : Iheir Development 

and Interpretation," Kcscarrii l*apcr No, Laboratory of Educational 

Pvesearch, University of Colorado, Septeirier 1968 (also presented 
at tilt* annual meeting of AI'KA; Los A^ngeles, Calif., 7 Februai^^ 1969) 
(with A. H, raKsiian). 

"ivc ntnvraiions cl ivalu,aiun Models." I’aper presented at the Nebraska 

Sonne 1 and Gin nance /V?sociatlcn Meetings, IJncoln, Ni^b,, September 
/ ^ i • . 

"t.iuic.ii I '’li.i 5 %'!>/' Phi i/elta Kappa, jO , 148-131, h'ovenber 1968. 






*'TUe UKternal Validity of i’.xperinents American Educational Uesearch 
J ourna 1 , <i37-47^, November 1968 {with C, il, Bracht). 

"i;stab llaiilnp, a (Graduate Kcneardi Training Program and the Laboratory of 
Lducational Keseordi," Tinal Report LS(jI^ Project 6-1860, 
Laboratory of educational Pesearch, Lniversity of Colorado, November 
1968 (witii K. D. Hopkins), 

"Correlations with Products of Variables: Derivations and Implications 
for Methodology,*' Air»erlcan educational Research Joumali November 
1968. 

"lUe Uoman-De lacato Rationale; A Critical Analysis," Educational Iherapy, 
H'inter 1968 (with M. P. Robbins). 

’'Analysis of Datr on the Connecticut Speeding Crackdown as a Time-Series 
Quasi-Experiment,*' Ljt^ and So ciety Review , Winter 1968, 

"Review of Ch.issan’s Research Design Clinical Psyc hology aixd Psychiatry 
Educatitual and Psychological Measurement , 28 , 62 1-62 3,^1968 (with 
A. R, Hakstian), 

"Response to Traub's 'Note cn Che Reliability of Residual Change Scores,*" 
Journa l of Educational Measurer^int , 265-26 7, 196 8, 

"a Simple Proof that the Sum of the Squared Errors in Estimating Y 

from 2^ via and 6 q is Kiuimal/' / ^ericar. Statistician , 25-26, 

January 1969 (with J. C, Stanley). 

"ftie factorial Structure of Reasoning, Moral Judgment, and Moral Conduct." 
fNiper presented at the aiinual rrieeting of the American Educational 
Research Association, Los ^\ngeles, Calif., 6 Febrtiary 1969 (with 
W, lieth Stepliens, J. A. McLaughlin, and C, K. Miller). 

"The Effects of the Position of an Organizer on Learning Meaningful 

Verbal Material," Keseard ^ Paper No. 24, Laboratory of Educational 
Keseardi* Cnivursity of Colorado, January 1969, (Presented at the 
annual meeting of ALKA, Angeles, Calif., 6 February 1969.) 

(with I-, L. Bauman and S. A. Harrington) 

" ihe Approximate Sampling Distrioiit. Lon of the Stratified Alpha Generaliza- 
Id Ktv Coe f f i c lent R esearch I’aper Wo. 26 » Laboratory of Educational 
, Cniv.‘r:dty of Colorado, January 1969. (Presented at the 
nn:ui,i I meeting ol 2JJiA , Los Angeles, Calif., 7 February 1969.) 

(wiLf* K. 1., Mendro) 

" ihe '-nwtii of i. valuation ricthodology Rcseard\ i'aper No. 27, I.aboratory 
I du< .it i ona 1 Kosenreh, lniversity of Colorado, March 1969 (Third 
VI r s i ou , r 58 np). 

"Hu- I \pi*rux'ntal Inir lo Statistital /analysis," r<p.search Paper Wo. 28 , 
L.ioor at ^ rv ol !,mj ent i nnal [research, lniversity of Colorado, March 
I v'Mtn P. i, i'cekhan and K, J, iiopkins) 

"Plan .in ih‘ I'uliiro o» ti^c Review ol Rc'.ucatl ona 1 P.cscardi . " Paner prepared 
1 If ii.»' r.s Ol 1 .III ui Councl 1 of the Ai^erican Educational Keaeard; 
Assoil.uion, April 1969. 12 pp. 



Hrltish t>;ickil(«vn on Drink in)’ cmci Driving': A Successful Le^al Keiorm," 
K eseard^ Paper No. Laboratory of Educational Research, University 
of Colorado, l?ay 1969, 30 pr>. (in press in American Behavioral 
Sclent is t ) (with ht L, Ross and D. T. Campbe llV 

Mn jtcry lest J toms f nr C ourses l.ducattonal Kesearch Methods , ijoulder , 

Colorado; i,aboratory of Kducitional Keseardj, University of Colorado, 
May 19ti9 , ^2 pp. (wltli J, K, Sanders and S. C. Jars). 

’'Note on .Iciiaen an<l KoUwer's ’Mental Ketardatioii, fiental Age, and ‘ 'ling 
Kate,**' J ournal of Educational l^syciiology , I960. 

"Review of daggaley’s Mathematics for Introductory Statistics , A Frogrammed 
Review Educational and P sychologi cal Measureren t , Fall 1969 (with 
J, r, Collins). “ — 

"iJelacato — Ueurologls die Organlsatic en I^eesoudf rwi js : Fen Kritick," 

Fedagogish Forum (in press) (with M. W Robbins and J. Tulnnan) . 

"An Analysis of L>elacato*s Experimental Kvi deuce," Pediatrics (in press) 
(with >'i, Okada) . 

"isometric Proof of tne Restriction on the 1‘ossible Values of when 
and r are Kixeti," lidu cat tonal and Hsy cUolo;.^ical Me as u rer e nt 
(in press; (with J, H. Collins). 



X, r rof casloiial Stall 



l9bJ;-69 



Dr, Kenneth D, hopUlns served as Director 
while Dr, Gene V. Class served as Co- iiirector. 



of the IJ:^R during 196d-69, 
Tile il.R Fellows gave their 



opinions to these directors on one item in Hues 1 1 onnai re B. 



Concep t ; I-EK Directors 

1 2 3 > 0 7 



Approachable b 6 
i,'ot Uelnful 0 0 

ciiolariy 10 2 

Corpetent ^ 

Acininist rators ^ 

V-GspettoC 

re rsma 1 1 v ^ 



0 

* ) 

0 

1 

u 



u 0 u b 

D 0 3 a 

0 0 i) 0 

1 o 0 0 

U D 0 0 



Not Approaciiab le 
He Ipf ui 
N'ot Scholar ly 
inconpotent 
Administ raters 
c Respected 
Personally 



1 hj r- A, 



it i- niui'.n.ii'o tji.it pers{»(.<; tC interest In educational research 



i!K- iiM'Ui J • • . viK.’ join i.( sciiool Education faculty will joint actively 
in II**' ,ian .‘ssurx’ .) nt,itv of t!u grwlng responsi bi 1 1 1 1 es . In August 




«>■ 5% 

hG 



of 1969, i)r. lilaine K* Wortiien joined the faculty as assistant professor 
of educational psychology, with particular responsibilities for the 
researcii and statistics progran at the Denver Center* IXiring 196^J-70, 
Kenneth 0* Hopkins will continue to serve as Director of the LER, Blaine 
Vorthcn will serve as Co-Director, «md C^ne V. Glass will serve as a 
staff member with special responsibilities for developing an evaluation 
unit for the 

Resumes for Hopkins, , and Worthen appear in Appendix B along 

with resumes for all persons who insttuct in the core currlculucn* As 
a new faculty nember not previously «v:sc dated with the li^R, a more 
complete vita for Dr. Wortlien is included in this section* 

Vita - illaine i‘* Worthen 



Present t^osition ; 

Assistant Professor of hducational i^sychology, School of Education, 
hniversicv of Colorado 

Educational Data : 

li.S. - University of Utah - 1960 
N.D, - University of Utah - 1963 

Ihesis; ^'i;iscovery vs. l.xpository Classroon Instruction: An 

Investigation of Teaching Mathematics in the Elementary 
Sdiool,” Unpublished raster's thesis, University of 
lit all, 1963. 

Eh.D. “ The C^iio State University - 1968 

Dissertation: 'Uhe Impact of Keseardi A-ssistantship Experience 

on the .Subsequent Career Devdlopinent of Educational 
Kcsearclurs * " Unpublished doctoral dissertation, 
i he Otii o S tat o L’n Lve rsi ty , 196 E . 



Kotu ir s i e ce 1 ve^’ ; 

I. Jnlvei.sijv I t Jj Normal Scholarship, 1939-60. 

, r+*ji'ivct' r..S. witii '9iig,h Ho-iors”--e lected to Phi Kappa Phi 
u onoi ‘iiK 1 1' I '/ , 19 6u . 

>* ^ T,v\te*\ a '’Doctoral Internship in Education” (national feilcwsliip 

c w? po 1 1 1 1 on) at Inc (hto State Lnlverslty, )963-67. 




U7 



Honors KocelveJ (coat*) : 



Chosen as '^Stuff Associate" (national fellowship competition), 
University of 1963. Declined, in order to accept offer 

at The Otiio State Uni’/ersity, 

3. Selected as the 1968 Oiilo State UnivotsJty I’Jesiier Fellow (Annual 
award to outstanding, male graduate student In education at The 
njiio State University) , 1968. 

Profess tonal Positions: 



1, Elementary sdiool teaclicr, 1960-62, 

2, Instructor, University of Utah Campus Scliool, 1962-6 A, 

3, lx 2 cturer in education, Colle^^e of Southern Utali, sumrier, 196A* 

A, Instructor, Collepe of Uducaticn, University of Ital*, 196A-65 
(ha If Llnx?) , 

3. Re8earcl\ Assistant, Department oi Educational Paycholo^y, 

University of Utah, 196A-63 (half tirne) , 

6, Doctoral Intern in Education, School of Education, The Ohio 
State University, 1963-67, 

7, Kaseardi Associate, College of I. ducat ion, The ihio State University, 

190 7-68, 

8, Associate Director, Evaluation Center, The Ohio State University, 
1907-69. 

9, Assistant Professor, College of Education, Th.e Cnio State 
University, 1968-69, 

10. Asaisiiint Professor, Sdinol of l^ducation. University of Colorado, 
10<i9-itrc6eiU , 

Contracts . uul (^ rant s Fe cciv eJ Projects Directed ; 

Comp io t ed • 

Director, ;>iatlonal Evaluation Ljcade rshlp Project, 1967-68. (Funding 

rocelvc<l wiU\ 0. L. StufUcbcam) ESEA Title III, $A8,000 (12 months). 

inrt it.k- 1 , r»trat«'^ius for I ducati in'ka 1 Oiange; A Uisserination Project, 

! 'o.'-uH. iin* (hio State University Developr:«nt Fund, $8,000 (12 monCis). 

I'lr'Mtor, < . S . L . - - ■ cnia Evaluation Project, J9C8-69. (Funding received 
■vit i t), f, : tui ; lebearn) ESI./ fitlc Hl| $27,110 (12 months). 
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Contracts and C rants Kocelved anJ }^roH*cts Directed (cont.) : 



Currently Undetvay : 

Director, National Study of Itcsenrch Apprenticeship Experiences, 

1968-69. P)\i Delta Kappa International, $8,390 (18 nonths) . 

Director, AKRA Study of Hequl ren^ents and Procedures for Training 
Researchers and Research- Re lated l^ersonnel, 1969-70. VSOE 
Research Training Branch, $67,6?? (18 months). 

Academic Teaching Experience : 

WorKshop In leaching Mathematic? ((.ollege of Southern Ut ah-Summe r , 

1964). 

Eleirentary Mathenatics Sections: hlemontary Education Practicum 
(liniveratty o/ UtaJi-Sumr<;r , 1964). 

UorRshop: f'ethods. Materials and I^rocesses in Arithmetic (University 

of UtoJi-Autum, 1964-Winter, 1963). 

Evaluation Kune t lens and Methodology in Education (Hie Ohio State 
Universi ty-Snrinp,, 1968, teaTxjd with D. S tuf f iebeam) . 

Seminar in Educational Research (Ihe fHilo State Entversity-Winter , 1969). 

Research Processes: Practlcun in Educational Research Ohe Oiio 
State Eniversitv-Winter , 1969 , teained with K. Bargar) . 

Experimental i)esl>n in Education (Tiie Oilo State University-Winter, 

1969 , teatred wii.li E, Herit^ond.) 

hicnentary Statistical Methods (Lniversity oi Colorado-Fall, 1969). 

Evaluation f ’ode la and Proerdures (University of Colorado-Eall , 1969). 

Methods of EducationaJ J’eseard> (University of Colorado-Spring, 19 70). 

Mther Proiesslonal Kxpe r L e acc : 

1. Part I clnant In Natlcrual Scitnicc foundation Summer Institute in 
Mathematics, Uni vora I tv cf It ah, June-August, 1963, 

2. (onleree with In'versity o: Illinois Comnittee on School Mathenatics 
(UlCSM) , Jnnurijv 13-18, 1964. 

5. Discussant, C tunc 11 of Teachers of Matherratlcs , Modern 

’Mther.itlcs (on fere rice for I'ro-servlce Element a rv Icachera, 
feh I u 1 I V 1') , 196 4 . 

•I. ( 111 s t U\structor (with S. f'. jcncks) , In video-taping a series of 

Mi • t ru< i i tnoi 1 IV programs, Including discussions and classroom 
tierons t r nt 1 <>n‘. tn modern c'athematics instruction. University 



Auvh »>-Vi sua I Aid Departriant, 1964-63. 



Cl 





other t’rofess Lonal exp er ience ( coat , ) : 



*)• J:dltor» St rate ^^ios lor Kciucatlonal CYiange (SEC) Nevs le tter , The 
(^ilo State University, 1966-68. 

6, I'artictpant in Tralnlnf, f'rcrrnr' in tl;e Ise of Xanar.eTrent Tnfornation 
Systems in Educational Kcsearch and Development Activities, Tl)e 
Miio State University, Decen^er, 1966. 

7. Cue St Editor, Tiicory Int o Practice , June, 1967. 

6, Conaultant , ESEA iitle HI directors. State of Indiana (on evaluation), 
iNovember lA, 196 7. 

9, Consultant, ^vayinaw City School System, SaJ»,inav^, Michir.^ (on 

evaluation design and process for regional supp lerr\en tary service 
center, lit ie HI, ESJ:A) , October, 196 7-present, 

10. (annuitant, Kanawiia County Schools, Qiarle.ston, West Virginia 
(on evaluation design and instrurrentati on for exen^plai^ space- 
related science project, Title HI, ESEA) , l;ccerriber, 196 7-May, 1968, 

11. (,onsultant, Mid-(.ontinent Hcgional Educational Laboratory (on 
evaluation and research design), Eebruary 19- H, 1966, 

12. orgajiizer anu Senior Institute Instructor, National Science 
Teachers Association Institute on Evaluation for Science Program, 
Wasnington, D.C. , March 2A-27, 1968, 

13. I>ecturer, l.aCiri American Institute, The Oliio State University 
(on me asurcTnent techniques), April, 1968, 

lA. Consultant , Educational I’lenning Mission to Ecuador, Agency for 

International Development (on designing a study to assess institutional 
capacity to Implemont educational plans). May 13-15, 1968, 

15. Selected as participant In Second Annual S)mpo8lum, National Society 
oi iMolessors of Educational Kesearch, IViiversity of Colorado (focus 
on tleve lopircn t of instructional materials in L, D, ^nd D) . November 
H-7 1, 196b, 

io, (onsultant, /ppalaciHean i’egional Laboratory (on conceptualizing 
an information system for process evaluation), Decerr^cr 13, 1968, 

17. I t-niau It an t , Xenia City Sdjools, Xenia, (Hiio (on developing a 
iiti* HI, ESI. A proposal), Uecenber, 196 &- January , 1969, 

18, U^cturer, liefvnse Manaperx*nt Center, Wri ght-Ea tt e rs on AEB , Chio 
(scries of Iictures on ri^eiLsuremient and evaluation), January-Aprll , 1969, 

1^, mri'anlzcr, : y n >i>s i urn : An Analysis and Synthesis of Pecently Completed 

Irpiiit.i) Situ dies i^clated to draining J. ducat ion a i Kesearch, Development, 
anc. Ui ssc- i na ti On Personnel, The American Educational Pesearch 
\ss<H i Lion <\nnu3i Meeting, Eebruary 7, 1969. 

'clectoti as discussant in Ninth Annual l^hi Delta Kappa Symposium 
j EuiJcationH Research, Salt Lake Cl tv , Utah, 10-12, 1969, 



lUJ 



outer Trof essi cnal liixjujr ifnce ( cent , ) ; 



21. Orj^anizer ami Instructor, Institute on K valuation, Elk Grove 
Training, cjid Li^velopmcnt Center, Illinois, March 3-6 , 1969, 

I'l ^ Sclcctoil as participant in ;\1:KA postsession on oxpcrinental 
(JcHir;a, College I' ark, Mm v land, March 2iv-Apri 1 1 , 1969. 

23. Consultant, l>ar tholomow lionsoHdatcd Scliool llistrlct, Colutrijus, 

Indiana (on developing an evaluation design and monitoring system), 
June 19-20, 1969, 

2 - 1 . Lecturer, IJlinois Program for the Gifted Summer Institute on 
Evaluation of Learning, July 28-30, 1969. 

2.6. Lecturer, EPDA Institutes on Evaluation, Columbus, Ohio (lectures 
cm meafiurerKin t techniques and use of simulation in training 
evaluators), July 7-11, iVb9 and August ll-l^, 1969. 

26. Prop.rnm Uiairman, >\EKA Special Interest Croup; Professora of 
I.ducatlonai Research, 1909-70, 

27. Consultant, Colorado State Jepartment of Euucation, Denver, 

Colorado (on the Colorado Assessment Program) , 1969-70. 

Membership I n Professional Associatic n; ; 

Local, State, and National Education Association, 1960-64, 

Phi Delta Kappa, 19C4-pre3cnt 

Anerlcan Educational Pescardi Association, 1965-present 

Association for Supervision and Curriculum Development, 1966-69, 

Natlfjnal Society of Profeasors of Educational Research, 1968-present. 

Profession..! s?rl ting s : 

Kooks and Mo nogr ap 1 ^ 

' lark, D. & l.’orthen, 6. P. (Lds.) Preparing Research Personnel 
for Education . b 1 oomlnnto]^ , Indiana? Phi Delta Kappa, 1907. 

HorllK'n, li, R. ^ !ila[du;, V. L. (Lds.) Strategies for Educational 
New London, Connecticut: Crofts Educational Services. 

(In p re 3 s ) , 

tjinpLors in books and Monog,raphs 

Kro.;peji, S, M, i, Worthen, (’,. K, "New Kolos for I’ubllc Schools 

In jr.ilnir.g Educational re-,earchcr.s in Clark, D. L. 6 Jorthen, 

P.. (l.Js.) repat inp Kos c arch Pors onne 1 for Education. dloonlngton, 

I mil nun: Phi Delta !Cappa, 196 7, " 

'''‘i K. ■. -.oirparison of Discovery and Expository Sequencing 

.rj oiencntar-; atnorrati t s i n U rue t Ion In Scandura, J, M, (Ed.) 
^osearr : jtner ailcs i duCat i cn . S at 1 on a 1 Coun cil of Teachers 
id '.>t nerrat I cs , Idh 7 . 
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Profesfitona] W r ltin^:s (coat.): 



Articles Published In j* ro fesa Iona 1 Pertodlcalii 

Worthen, li, "ihc liiriovati on Dilemma/' Strate;;ies fo: Educational 

Ui an (ShlC) News letter . Volume I, Wuriber 10. Noveirber, 1966* 

iiopktns , J, L, ^ Wortlien, B. K, "Change In Public Scb .Os," 5> t rategtes 
for Lducational Change (NKC) Newsletter, Volume I. Nu.ii')er 12, 

May, 196 7. 

Worthon, B, i<. "The Evolution of Title III; A Study in Qiange," 

Tlicon^ Into rractlce . Volume 3, Dumber 3. June, 1967, 

Aslo reprinted as: "A Change in Title 111?" 

St rat egl G3 for Bdu ca tl onal Change (SKC) 

News let ter , Vo1uit« II, Number 2, November^ 

196 7, 

Worthen, B. K. ‘’Discovery and Expository Task J’resentation in 
blementary I'.atliemati cs ," Jou inal of Educational Psychology , 

Monograph Supplement , Volume 39, Number 1> Part 2, Fabruary, 1968, 

Wortlien, B. P, "A Study of Discovery and ExDOsitory Presentation: 

Implications for Teaching," Journal of Teacher Edueslien , Volume 19, 
Nurber 2, Summer, 1968, 

Vortlicn, B, P, "I'oward a Taxonomy of I;.valuatlon Designs," Educational 
T eclin ology , Volun*e 8, Nunher 13, August 15, 1968, 

Heports of Research Studies 

Della-Plana, C, M, , KJdredpe, G, , 6 Worthen, b, R. Experiments In 
its cove ry Loam In pj Par t Seguen ce Characteristics of Text 
Materials and Transfer of l^eamlng . Salt Lake City; Bureau of 
Educational Research, University of Utah, 1965, (Part I of final 
report of DS(;E CRP Project 2277), 

Worthen, B, K. , Eldrcdge, G, , and Della-Plana, G. M. Tasks and 
Tes Ls ; l*art 1 1 , Sequence Characteristics of Text Materials and 
Transfer of Learning . Salt Lake City; Bureau of Educational 
PcseareJt, Inlversity of Utaii, 1965. (Part 2 of final report of 
CSOE (KP Project 22/?). 




Wovthen, B, R. "A i'e-analysi of Normative Data from the Nat 1 ona 1 
Jc gls ter of L due at. 1 onal Krscardiers : Implications for Research 
lralnlng,^in Clark, D, L, , and Hopkins, J, E, , A Study of Roles 
lor Researchers in Educat 1 on , Bloominp.ton , Indiana; School of 
Education, Indiana University, 1968* (Final report of USOE CRP 
Pro jei t X-D22) . 



’ortii^n, B, }v, N ]'oadcn, A. E. Ihc Impact of Research Apprenticeship 
i xpo r i on cc . c.olum!)us, fhio; Evaluation Center, The Otiio State 
University, iVDh, (Uvterim report of special PUK study)* 

loM .en, D, K» , Kean, M, H,, and McLaughlin, Nancy, Eva luat i on of a 
Proct-ss S or Se letting and T es tl Educational Innovations , Columbus , 
(liic; r, valuation Center, 1969 (Final evaluation report on third year 
of 1 ClLv ^)ChooLs Ittle Til), 







rof esijlonal Writings ^zcnt.): 



Test Authorsiiips 

W o r tii en , 15* K , t, S t u f f } u b c ar , D , L , The Oluo State Uni ve rsity 
Research Competence Test « Columbus, Chio: Test Deve loprr>ent 
(^nter, The Otiio State University, 1968, 

Papers Read 

W or then, li, K, "Some Notions About a Taxonomy of Kvaluation Desigr^s*" 
Presented at the American Kducatlonal Keseard\ Association 
annual r^e tin g , Feb ruary 8 , 1968, 

Worthen, ii, H, "A Study of Research Apprenticeships; Implications 
for Training educational Kesearchers . " Presented at the American 
Lducational I<escarch Association annual meeting, February, 1969 * 

HccasLonal I'apcrs 



liock, M, \u & Worthen, H, k. "Simulation in Program hvaluation; 
i‘iGthads and Materials for Training i'ersonnel," Columbus, Ohio: 
evaluation Ointer, Ihe Mhlo State University, 1968, (nlmeo, 62 pp,) 

Worthen, 8, K, " lx:ve lopw ^>1 a Functionally Penote Associates 
lost (IKAi)," Columbus, Uilo: School of education, iht Onto 
State Iniiversity, 19b 7, (mineo, 31 pp*) 

Wortlien, A, K. 6 licck, M, I), "A Simulated Fvaluation Design Problem: 
Rasls i or a Training IiisLitvtc in Evaluation," Colunbas, Ohio: 
hvaluation Center, The Ohio State University, 1968, (inlneo, 80 pp*) 

Wortiien, li, K fc» Koaden , A, L* "Are Members of the American Educational 
Keeearch Asanciation Ke^carche rn ?" Research Paper Ko, 33 , Laboratory 
of hducational Rcceardi, University of Colorado, October 1969* 

(mirreo, 38 pp*> 

U’ortnen , ''. * K, 6 Clark, P, : * "Toward a llicory of Remote Aasociatlon* " 
Reaearcn Paper So* 3^, Laboratory of Lducational Research, University 
of Colorado, October, 1969, (mimeo, 41 pp*) 

Credentials nud f'&lcr e nces are Available From ; 

Filucnt i mal PerstnincJ FlaceT:ent, Ihe Chio Stalo University, 1945 North 
high Street, Coluibus, Olilt» ^3210 

(OedeuClala that include mort* ccm]>lete coverage of experience prior 
tu Iv' • are available from ttie University of Utali Placement Office, 

'all Lake City, Utah 84112) 
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XI . 

Kail l‘U>) 

Auftuot Z1 - HM’ 1st rai i o;v us 

Uecetnlier 2\) -* conclusion of tinnl uat i ona 

Sprlnj^; Semes icr 19 70 

Jaiiuary - re tr ation begins 

Hav -*3 ~ conclusion of final e xaniinati ons 

S\3mnk*r Session I'i 70 

June 19 - re j'i St rati on hei-ius 

Auy.iist 1^4 ~ cone i us Lou of final examinations 

ball Semester 10 70 

August 2() - registration be^vli.s 

becenber 19 - conclusion of ilnal examinations 

Spring Semester 1971 

January 13 - registration begins 

l\zy 11 - conclusion of final examinations 

Summer Session 1971 

June 18 - registration Logins 

August 13 - conclusion of final examinations 

Xn , y>cAHU retr<^n t of i K H Agalns t Standards for Kesearen Training ^ f 
Lducatlonal resei-rcbers , professional educators, social scl 
and government planners are not of c^ne mind as to what constitutes - 
exemplary rcser.rch training program* It Is doubtful that unanlrois 
agreement among them is attainable on a single Issue relevant to wui 
Ujc next educational researchers should be or what they should bv 
lortunaleJv, }»owcvor, the problem of I'esearch training in educatic i : 
not totally vi til out a lew standards t>f excellence to which the r.a ) l i 
ut respot <iji‘ servers would i r ibe . A concise and thoug.htlu'' ‘ 

nci\. i* (oc sued 4',t of siandards was the product of a Study Crju c 
i>: I ducat iona ^ Kcscarchers^ w'nich was ostabllshed joint 1' ; 

tnc Ar^,Tw.ra i .du c.i [ \ i u a 1 !\.sejrcii /vis oci at 1 oti and I'hl Dolta Kapt)a, 



o 



report of this study ;>roup was published aa Preparing Rese ar ch Pers onne ] 



f or h ducati on , iJcivld 1.. Mark and bialne M. Worthon, editors (196 7 bv 
AJ-: KA an d Pli 1 iie 1 1 a K app a) . 

(Vi paRes of the report cited above appear a set of six recotn- 

memlattonH for educational research tralulnp; which will be adopted here 
an standards nRBinst which to treasure the quality of the LER training, 
propran. Eac>i recomniendat 1 on (standard) will he stated and followed by 
a sutnmarv evaluation of thv LER program relative to that standard. 

1, jhnrochi ,1 lisni , in whatever ,'-;ulse, rr,ust be abandoned. ihe 
disciplinary empiiasis must he exterided beyond psychology. 
i\cw R and u roles inus t bv cr,b raced wit It in the research 
community. A J 1-un i va rs 1 t y concern for research In educa* 

1 1 on iiius t he f os t e r e d . 

llie charpe of patoclilaHsm in the sense of underpraduate training, 
course work at the praduate level , and researdi experiences can, certainly 
not be leveled apainst the li-R training proprar. As can be seen in 
Section VJ-*b, a broad raiiRG of undergraduate acaderrdc majors are repre- 
sented in the proup of rellcws. J-'oreover, in rjoction IIl-B, it can be 
shcT/n that 33 per cent of the credit hours of course work taken durinp 
were outside of the School of Education. In addition, Follcx^^s 
consulte witi\ If Jifferent aca ’e:nlc dopartrrients and units vcithin the 
ini vers I tv. 

Hivever, tlu? nu 1 Li-d Is ci p 11 nary nature of the curriculum could be 
lirprovei!, of the 33 per cent of the course work o.*tside of education, 

])cr rent was In psychology. little or no work was taken in socioioRV, 
economics, an Uirc ,u)lo),y , or philosophy. Ihe responsibility of the 
paroch i . 1 1 i > II ol the tralninr prop, ran nust be borne in equal parts, perlisps, 
hv ij ' ' Lne u aden 1 c dGpartrrents involved. 'Hie social sciences have a 
!'w» > ti ii ' i u' i I vn I ch ( m rr.iav unive rs t ties) amount? to a 

t icrtu I ) . r vc.ucrn and fntcrcsL for nnythinp. of i'^ortance for 




< • uiu I L i on . 



lUb 



2, 'Uu* centrality of rescardi to tiie cilucational enterprise 
must be affimetl. Schools and co lie cos of education 
must produce or adnit, once and for all, tiAat they 
cannot. Local school ar.encles must be as concerned 
with improvement as with survival, 

Making researcii central to the efforts of the School of Lducatioa 
of the University of Colorado piobahly lies beyond the scope of IJIHN program, 
hou'ever, the total research program of the School of education must surely 
have beon enhanced by the expenditure of almost 1,500 nan-hours ^ LLP 
Pei lows in consultation with Scl;ool of Lducation graduate r^tudents and 



f acuity • 

3, tJew and vigorous program's of student recruitment must be 
undertaken to change the character of the graduate student 
body interested in research in education. Possibilities 
for careers In educatlonnJ re.search must be identified 
for b right unde rp,raduatcs In many fie Ids and these stu- 
dents must be encouraged arnJ supported in their pursuit of 
these career lines, 

Ihe lilK training, progiam has been conspicuously successful on this 
point, n.e IJ:,K Fellows can be seen in Section VI to be among the most 
ai) lo entering graduate work in any academic field, Ihe mean Graduate 
Pccord j’xaminaiion (Verbal + tjuan c 1 1 a tive) score of 1333 is above the 9 7th 
percentl lu graduat in g col lege seniors. The mean age of the twelve 
Fellows in residence during; 196b-69 was 28,7 years, ihe mean age for the 
twelve Feilcr^s beginning the l9b9-70 year has fallen to about 26 years, 

Ihe ability .and scholarly promise of the students attracted to the 

U:K training progran^ ,ire its bri'.ditest feature, 

i.xten.sive experi T-kentati on sliould be undertaken in Institu- 
tional arrangcr<?ni s and program content for the training 
i'f rose a tellers In e ducat irtn, 

ivpical ins 1 1 1 ut i ona i restraints make “extensive experimentation with 
irist I tijt i oiia 1 ar raivei' uu t s“ by iJJv nearly Impos.sible, Such expert nen t tng 
'•lln ar r ii\*»'i^cnts is possihle only with the cooperation of other acaderde 
do n.i I ti vnt V .ind liiouccrcnt (»f funds, the latter being a major factor 

In obi all; 1 Ilk the tonr^cr. 
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J.Kf>e r i I ic'jj tl on vLth die training: program content is mucSi iti 



evidence. React tuns to course work and Intornshtp activities ai*o i’atiiered 
com i\ium;s Iv hv Imtli InfornMl and fornaJ Titians. lliir; corcit.uil nonlLortiic 
oJ Telliws* react lonr. to tiie proj;ram content lias resuJte<) In the dropping 
of courses frotr. the core curriculum and the addition of others, the- 
advtflejTjent of Fellows on preferred Instructors, and clian^ing the Internship 
requircr' nt and arr an^^ements to better fic intern needs. 

3, ihe pro;: ran content shcnld emphasize opportunities for early 
production on the part of the student, continuous involvcrent 
with productive .irid successful researchers, and field experi- 
ences in the conduct of research, 

i{\e Ltd training. proKtam Is exemplary with respect to this standard, 
First, many Fello\ys have established records of scholarly productivity 
timt far excceil tliose of most education doctorates in tiic nation and 
compare tavorably wLtli the early records of present leaders in educational 
research (sen iicswi ll, et ’’iralnin^^ for Educational Research,'' 

Cooperative Kosearch I’roject No, 310VA, 1966). As can be seen in Section VI, 
eleven oi the twelve I el lows produced scholarly writings during the 
19c>h-C)‘l academic year. ihe total number of w’rltings and publications 
by these eleven Re Haws was 3^; tliese writings ray be classified as follows: 
iype ot ^'rl t in^ Frequency 

10eHeara\ lei^ort (excluding thcries) 23 

ilouk or le.it Review 6 

OissertaMon or Hu sis 3 



Contlivjou.s I iivo 1 venen t of the Icllfrws with productive and successful 
re^;eilrcueri^ jnvS tie id experiences in the conduct o{ research are apparent 
both i.. 1 1 ..' hrc.iu scope of Ji-R’a consultative services witii eighteen 
ijepa 1 1 iTx.*nls .ind units of lue University of Lolorado and numerous agencies 
outside fio Is i ve rsi ty. 
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* Tile li'iiqueness of scholarship in education should be 
rccognl7.ed and accounted for in planning training 
proRtatiis for resonrch in education. This will nean 
setting tiic SLape at tiio graduate level so that sub- 
sequent collegial relationships can develop which 
will allow the researcJier in education to bridge 
his InvolveiUL-nt In a social process field and his 
commitment to a discipline of study. 

liie objective implied by this recommendation is striven f 

aspect of tile UiK training program: in recrultirvent , selection, 

course work, and internship activities. 
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DEPAFiMENT 0? HEAI.TH, EDUCATIO.'i’ AND WELFARE ^^jOGrT BURfAU NO. ai-R5?3 
Offlcn of Kducatior^ approval UPiflCSi ?-l»6ir 

Washington, 1),C, 20/^02 .m.« .h 



EDJCATIONAL RESEARCH TRAINING 
PitXPAM BUDGET 



USQ£ USE ONLY 



(P.L. ‘83-531/ Secti-n 2 (b), as 
amended by P.L. 89-10, Title IV} 



SUPPORT FOR GRANT PERIOD 



I, TRAINEE SUPPORT 


III, DIRECT COSTS 


A, Stioen( 


Is 


A. Persorinel 


1, Level 
and type 


2. Sti- 
pend rate 


3. No, of 
trainees 


+ , Amount. 


1. Type 


2, Full- 
time 


3. Part- 
time 


4. Amount 




2.600 


3 


$ 7 ,Sfin 


Program director* 










2, BOO 


S 


1 .'i nnn 


Prof, staff 
















Other staff 
















5, Subtotal: 












B, Consumable supplies 
















5, Subtotal: 










D. Dependency allowaiice 










1. Level 


2, Ra.^. 


3. No, of 
depend. 


Amount 






Subtotal: 




Weekly 


$ 15 






C, Equipment 




Acad, yr. 


400 










Fxai yr. 


500 


_ 20. 


__iQ,oao 1 






S. Subtotal: 




10,000 






C, Travel and relocatioii coats: 


Amount 






fiOO 






D, Total trainee suDDort; 


32,^00 


Subtotal: 




D, Travel 




n. INSTITUTIONAL ALLOWANOF 










Ai Baaed on rate per trainee 






1, Level 
and type 


2, Rato 


No, of 
trainees 


k, Amount 


.... 








Graduate 


2,500 




_20.QOO 


Subtotal: 












E, Other direr. t costa 




























































Subtotal : 




B, ToUl 


Lnstitutlone 


il allowance 


-ii ?n,Qoo 


F. Total direct costs; 


1 



IV, TOTAL SUPPORT REQUESTED FQR.PRXRAM PERIOD 



Budget allocation 


1st yr. 


2nd yr, 1 


3rd yr. 


4th vr. 


5th yr. 


Total 


Trainee support 


^2 7.300 


[29,900 


36,200 


17 j inn 


^12, inn 


1 1*;A 7AA 


Institutional allowance 


.. 20.000 


120,000 1 


[20,^000 


^o,onn 


2 n'nnn 


jno'nn 


Direct costs 


iA,ood 


9,335 1 


1 








Indirect costs 


1.120 


74 7 1 


1 ' 'i?? 








Total: 


t 62.A20 


59.980 1 


LiUliQ 1 


-52,400 ■ 


SiZjLnn 


LjBRJiiUi... 



MAnr cf iki Ti Tvj r f CM 

ITn 1 



of Colorado 
Colorado 80302 



Tint Egtabllahlng a Graduate Research 
Training Program and the Laboratory of 
: E ducatio n Research 



TOCHNICAL PAPER NUMBER 3 



APPENDIX C 

s/j^PLE mcasuri::ment instruments 

Attachment I; Course Evaluation Inventory 
Attachment II: Trainee Attitude Scale 

Attachment III: Trainee Questionnaire on Program Operations 
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ATTACHMENT I 



(Revised - Tentativo) 



Course 



COURSE EVALUATION INVENTORY 
Instructor 



Date 



Directions : Please circle the number that best Indicates your response to each 

item below. A frank and objective response will be appreciated* Omit Irrelevant 
items. Note opportunity for corments on reverse of page. Thank you for your co- 
operation. 



1. The Instructor avoided confusing or useless 
jargon 

2. His speaking ability (enunciation, volume, 
etc.) was 

3. His treatment or students was 

4. The instructor was 

5. He was aware of students^ needs, 
interest, and difficulties 

6. He was able to alleviate students' 



always 12345 never 

excellent 12345 poor 
courteous 12345 discourteous 
over confident 1 2 3 4 5 too unsure 

always 12345 never 





difficulties 


always 


1 


2 


3 


4 


5 


never 


7. 


He . 


encouraged students to work independently 


always 


1 


2 


3 


4 


5 


never 


8 . 


’*ls 


reaction to differences of opinion was 


encouragement 


1 


2 


3 


4 


5 


intolerance 


Comment 


* On the back of this sheet, indicate your opinions about 


the 


instructor 






of the course. 
















9. 


The 


instructor's knowledge of the subject was excellent 


1 


2 


3 


4 


5 


poor 


10. 


The 


instructor was well-prepared 


always 


1 


2 


3 


4 


5 


never 


11. 


The 


basic concepts were made clear at the 


















beginning of the course 


yes 


1 


2 


3 


4 


5 


no 


12. 


The 


basic concepts were logically developed 


always 


1 


2 


3 


4 


5 


never 


13. 


The 


class VMS 


too teachcr- 












too student 








doralna ted 


1 


2 


3 


4 


5 


dominated 


14. 


The 


presentation of course materials was 


informative 


1 


2 


3 


4 


5 


boring 


15. 


The 


discussions were a waste of time 


always 


1 


2 


3 


4 


5 


never 


16. 


The 


comjBit tec/lab work was a waste of time 


always 


1 


2 


3 


4 


5 


never 


17. 


The 


instructor covered the material 


too quickly 


1 


2 


3 


6 


5 


too slowly 


18. 


His 


coverage of material was 


too 












too 








superficial 


1 


2 


3 


4 


5 


technical 
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Qgjaent : On the back of this sheet, write your eviitiation of your own participatic 

and involvement in the work of this course. 

Ill 



19 . 



The text, with respect to course 
objectives, was 



relevant 1 2 3 5 irrelevant 



20. 


The text was 


too 

difficult 


too 

12345 elementary 


21. 


Reference materials were useful 


always 


12345 never 


22. 


The text was 


up-do-date 


12345 outdated 


23. 


The assignments were clear 


always 


12345 never 


24. 


The number of assignments was 


too great 


12345 too small 


25. 


The asalgnments were 


too 

difficult 


too 

12345 simple 


'le. 


The assignments were necessary (not buaywork) 


always 


12345 never 


27. 


There was sufficient time for prt^'aratlon 
for exams /papers 


always 


12345 never 


28. 


The criteria fov grading were clear In advance 


always 


12345 never 


29. 


The concepts emphasized on exams/papers were 
relevant 


always 


12345 never 


, 30. 


The number of exams/papere was 


too great 


12345 too small 


31. 


The exams/papers were 


too long 


12345 too short 


32. 


The exams/papers were 


too 

difficult 


too 

12345 simple 


33. 


The instructor graded fairly 


always 


12345 never 


34i. 


The instructor returned papers promptly 


always 


12345 never 


35. 


The subject matter, methods, or skills 
learned will be 


very useful 


12345 useless 


36. 


The subject matter was 


up-to-date 


12345 outdated 


37. 


The course should be given to students 
who arc 


more 

advanced 


less 

12345 advanced 


. 38. 


The subject matter was Intellectually stimulating always 


12345 never 


39. 


Considering the credit-hours, the work required 

should be more 


1 2 3 4 5 


■ 40. 


I would like to take another course In this 
subject area 


definitely 


def Inltely 
1 2 3 4 5 not 


Q ^lUr Please write specific suggestions for Improving the 
participation and Involvement, or Irstructor on Cite 

11^ 


course, student 
back of this sheet. 



ATTACHMENT II 



CIRCE Attitude Scale No. 1.3 Name .. 

Attitudes toward E<tjcational Evoluotion. iiielow are a number of statements about the evaluation of educational programs. 
A program can he a lesson, a course, a whole curriculum, or any training activity. Consider each statement as a statetnent 
of opinion. If ) ou agree at least a ijttle bit with the .statement, circle the letter A. If you disagree even a little bit ^ ith 
the statement, circle the letter IX U you both agree and disagree, or if you have no opinion, leave the letters uncircled. 

A AGREE Dr. disagree Blank ^ Neither 



3 ^ 

2. A 
^ A 

.1. A 

5. A 

Cy. A 

7. A 

8. A 

9. A 

10. A 

11. A 

12. A 
1C A 
14. A 
n. A 

16. A 

17. A 
IH A 

19, A 

20. A 
*21. A 

22. A 
2h. A 



n Ihe mojof purpose of an educational evaJuatjon study should be to gather information chat will be helpful to 
the educators. 

D It is imfH^uant for the program evaluator to find out how well various people like the program. 

0 (i<-ncraJly speaking, an educatjonal program should he evaluated with reference to one or more "control" 
programs. 

The eval lator .should accept the responsibility of finding the strongest, most defensible, and publicly attrac* 
ti\e points of the program. 

D In evaluating a progran:, it 3S ar least as important to .study and report on the t>'pes of teaching as it is to 
study and report on the amount of learning. 

D The evMluator .should draw a conclusion as te> whether or not the goals of the program are worthwhile. 

D ft is more important to evaluate a program in comparison to whai other programs do than to evaluate it with 
reference to what its objectives sav rt should do. 

D Principals and superintendents should nor gather data about the quality of instruction in the classroom. 

D The task of putting educational objectives into writing is mote the responsibility of the evaluator than that 
of the educator. 

D ft is essential that the full array of educational objectives be stated before the program begins, 

D P valuation studies would improve if they gathered r. ^rc kinds of information, even if at the experse of 
gathering less rcli.ible information, 

[) r.v.iluators should ignore data chat cannot be objectively verified. 

n Kducation should have moie of an engineering orientation than rl now has. 

1) The job of an evaluator is mostly one of finding oat how well siadents learn what they are supposed to learn. 

D Ilvaluarion should aid an educator in revising his goals even while the program is in progress, 

D The process of decision-making about the curriculum is one of the weakest links in the present operation of 
the schools. 

D Tducaters have some important aims that cornol be stated adequately by anyone in terms of student beha%io:s. 

D Information from an evaluation study is not worth the trouble It makes. 

D The first job «n instruction is the fnrmul ition of a statement of cb]ecti\cs, 

I) A teacher should tell his studenis any and all of his teaching objectives. 

D IXe mojor purpose of educational evaluation j .s to fmd out the wortli c«f what is happentng. 

D The evaluatcr should be a facilitator more than a critic v: reformer or scholar, 

I) 5cmc s<hoo! experiences .ire desirable bcc,rfv.c they round out a child's lifc-whelher or not chey in 'tea'^c 
his competence or change his nttitude.s. 
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v> 



A 

2V A 

:(i. A 

2 -!. A 
2H. A 

29. A 
^0. A 

M- A 

32. A 

33. A 

34. A 
3^. A 

V>. A 
37. A 
3H. A 

39. A 

40. A 
U. A 
42. A 
13 A 

44. A 

4V A 

A 

47. A 
4K. A 



o 




I) An evaluator should find out if the teaching js in fact the kind that the school faculty expects it to be. 

D In selecting the criteria for evaluating an educational program it is generally better to concentrare on the 
obfcctives that it shares with other programs of it.s kind rather than to concentrate on its unique objectives. 

O The moin purpose of evaluation is to gam understanding of the causes of gotul instruction. 

n Description and v.iluc judgment are equally Important components i>f e valuatirm . 

D In ct)ndui ling an evaluation, there is no justification for the exercise of subjective judgment of any kind 
by the evaluator. 

D biducational evaluation i.s a nectssai-y .step in the ever^^day operation of the school. 

D The strategy of ev.^luation should be chosen primarily in terms of die particular needs the sponsors have 
for evaluation data. 

D T}ie educational evaluaror should attempt to conceal all of his personal judgment of the worth of the 
program he is evaluating. 

D Ihe sponsor of nn evaluation should have the final say-so in choosing or eliminating variables to be 
s ludied. 

D .^n evaluator should concentrate on gathering data about the costs and benefits of the program. 

D fharents’ attitudes should be measured as part of the evaluation of school progra.*.^. 

D An evaluator finds it almost impos.sible do his job without intruding upon the operation of the program 
at least a little. 

D All impKirtant educational ain^b can be expres.-ed m terms of student behaviors. 

D Some educatjonal goals are best expressed in terms of teacher behaviors. 

D The principal purpose of evaluation is to test out theories and hypotheses. 

D An evaluation study should pay less attention to the statistical significance of a finding than an 
instructional re.search study would. 

I) Kvaluation interferes with the running of schools more than ir helps. 

I) Little evaluation planning can be done before you get a statement of instnjctional objectives. 

D The leader of an evaluarik n le.im should be a teacher. 

n The entire school day and the entire school experience should be divided up and assigned to the pursuit 
of stated educational goaLs, 

n An evaluation of an educational program should Include a critical analysis of the value of the goals of 
the program. 

I) Kver)' teacher should have formal w.ay.s of gathering Information about the strengths and shortcomings 
of his iosiruction.vl ptogtam. 

D Money .spent on evaluation contributes more to the improvement of education than any other expenditure. 

D There just is no wav that careful and honest evaluation can hurt a school program. 

I) If an ev.iluatj(>n study is well designed, the prii'far)' findings are likely to improve deci.s: >ns made by 

admjni stra (I't . teachers, and sfuk-'lents themselves. 
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CIRCE Attitude Scale 1. 3b 



Name.. 



Different people have different ideas about the evaluation of educational programs. 
Some believe that maintaining a good school and improving instruction reejuire 
Carefully planned evaluation. Others believe that evaluation activities interfere 
\^ith reaching and learning, doing more harm than good. 

Different people see different purposes for educational evaluation. Certain people 
are oriented more to pupil behaviors or to classroom conditions or to other aspects 
of the program. 

Kcsponscs to the items on this attitude scale provide us with 6 scale scores. 

^Iien plotted on the profile sheet below they are expected to indicate the 
respondent's attitudes toward educational evaluation. 



Directioni for $«|f Scoring 

Start in the opp>osite comer of this 
page. For each scale check your 
sheet to see how you responded to 
each of the eleven items. For 
Example, with SCALE V how did 
you mark Item #2? If you marked 
it ‘^A’^ put a check in the paren> 
theses. Put the number of checks 
in the box. Mark each horizontal 
scale (at the fight) at the number- 
point shown in its box, Draw your 
profile by connecting your scores 
on the five scales, I-V. Then find 
your CONFIDENCE score. 



< <QQ< O < O < QCQ 
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i. A RESEARCH orientation to Evaluation "o 



33456789 10 



The person high on this scale appears to believe that evaluation should 
rely on precise measurement and statistical analysis to gain gtnerol 
understanding of why programs do or do not succeed. 



< 

U 



< Q 



< Q 
o 
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A SERVICE orientation to Evaluation 



77ie person high on this scale appears to believe that evaluation should 
be designed according to the needs of the educotors involved so as to 
aid them in their present w’ork and future decisions. 



U 



< < < Q 



< < < < 
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IM, A TEACHING orientation y 1 aluation o 



The p cfson high on this scale appears to believe that evaluation should 
be focused considerably on the eje :lity of ttoching and should discover 
the intrinsic merit in faciliues and in instruction. 



< 



c a < < 

vT r - O 



< < a 

O' VO r- 



< < < 



IV. OBJECTIVES orientation '^o f val ia tion o i 



LJ 



o 



The person high on this scale appears to believe that instruction, and 
therefore evaluation, should be focused considerably on apriori state- 
ments of objectives, that the merit of the program is largely indicated 
by the success of students n reaching those objectives. 



•J 

< 

U 



< < 
"«T SO 



<<QQ <<< a 
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V. A JUDGMENT orientation to Evaluation o i 



The person high on this scale appears to 

evaluation is largely a matter ■‘f establishing the worth of the program 

for \3riou s purposes ds perc'^t *‘d‘- — ’ ‘ 

and around the program 



' believe that educational 
hing the worth of the prog 
various groups ol persons in 



n 

o 



DC 

< 



To obtain an overall 

do the same thing with 
the check-list at the right. 



CONFIDENCE IN EVALUATION scof 
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ATTACHMENT III 



TRAINEE QUEc^TIONNAIRE ON PROGRAM OPERATIONS 



Please answer the following questions. If you would like to 
expand on any of your answers, use the margin. 

1. Did the unavailability of books and journals interfere with 
attempts to master the content of the training program? 

Yes 

No 



2. Did reproduced material handed out by the staff help you? 

^Yes 

^No 

3. Did you lack a place to work? 

Y e s 

No 

4. Was your housing satisfactory? 

Yes 

No 



5. Which features of the classrooms were inadequate? 

^Ventilation bad (including cigarette smoke) 

^Acoustics (inability to hear) 

Too large and spread out 

^Needed overhead or neck microphone 

Other (Specify) 

6. Which features facilitated learning? 

Space to spread out materials 

Public address system 

Chalkboards 

Raised platform for lecturers 

Other (specify) 

7. Was the length of the training program appropriate, too long, 
or too short? 



Appropriate 

Too long 

Too short 

8. Wore lectures too long? 

Yes 

No 




JIG 



9. Were the lecture^ appropriately scheduled? 



Yes 

No 



10. Djd you have sufficient opportunity to interact with colleagues 

Yes 

^No 

11. Were the instructors too unapproachable or inaccessible? 

Yes 

No 



12. Were graduate student assistants helpful in solving your 
individual problems? 

Yes 

No 



13. Did the evaluation interfere with your work? 

Yes 

No 

14. Did you object to spending time on evaluation? 

^Yes 

^No 

15. Was the instruction generally well organized? 

Yes 

No 

16. Did the content of the lectures presuppose more training in 
mathematics and statistics than you had? 

Ye c 
^No 

Yes (slightly more) 

17. Should less, or more, pretraining be presupposed? 

^Le s s 

^More 

About right 

18. To what G.xtent was the content relevant to what you hoped 
to accomplish? 




Relevant 

Not too relevant 



U 



19 . 



a. Were the 

b. Were the 

c. Were the 

d. Were the 

Yes 

a . 

b. ] 

c . 

d. 



lecturers stimulating and interesting? 
discussions successful? 

lecturers competent to speak on their topics? 
lecturers well prepared? 

No 



20. Were you disappointed in any way with the participants? 

Yes 

No 

If yo5 f specify why 



21. If you had it to do over again would you apply for the 
training program that you have just completed? 

^Yes 

No 

22. If a program such as this is held again would you recommend 
to others like you that they attend? 

Yes 

No 



23. Do you feel that your understanding of evaluation (development) 
has been considerably enriched by this program? 



Yes 

^No 

24. Do you feel that anything has happened during this training 
program to make it more likely that you will leave your 
present position of employment? 

Yes 

No 



25. Hov; valuable v,>erG your courses, in your opinion, in preparing 
you for your occupational responsibilities? Rank order the 
courses , from most to least helpful, below. 

Most helpful 1 




2 

3 

4 

5 

6 



Least }iel['»ful 



26. How valuable was the weekly non-credit seminar in preparing 
you for your occupational responsibilities'^ Please indicate 
below . 



21 . How valuable was your internship experience {s) in preparing 
you for your occupational responsibilities? Please indicate 
in the space provided below. 
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EVALUATION Ob’ LONG-*RANGK EFFECTS OF A 
1967 RESEARCIi TRAINING PRESESSION 



The evaluation of the 1968 Presessions Prograra necessarily 
deals v;ith short-term effects. Some indication of the long-term 
effects of the AERA Presessions Program are given in this section, 

A brief questionnaire was mailed to the 70 participants 
of the 1967 Presession on the Design and Analysis of Comparative 
Experiments. This Presession v;as held at GrossingerA New York, 
on February 3-7, 19b7, and was under the direction of Gene V. Glass 

Kenneth D. Hopkins, and Jason Mj liman. Thus, the questionnaire 
sought to assess the effects of one 1967 Prese.5>sion more than 
one year later. A total of 47 of the 70 participants responded 
to the questionnaire, producing a fairly typical return rate 
of 67%. The results arc eported on the questionnaire itself 
in Table E. 



Table B 

AEHA 1967 Presession Questionnaire 
Follow-up Evaluation 



Responses of the 4 7 respondents are recorded belov;: 



1. a. Have you made an attempt in the last 15 months to increase 
your knowledge of oxper imentai design and analysis a 
re su 1 1 of you r attendance at the 19 6 7 Presession ( i . e . , did 
you do something you might non have done if you hadn't 
attended the Presession?) ? 

Yiis - 41 No - 2 1 Circle one) 

Mo response - 4 



h. If "Yes," how? 
f recj . 

36 1. By studying the instructional materials handed out 

at the Presession. 

3^> 2. 13 y independent study from textbooks. 

j_ 3. J3y enrolling in a formal course, 

6 4. By attending one of tlie 1968 Pro sessions. 

5 5. By attending some other "short-course" or "workshop 

^ 6. Other* Please specify: 1, Conducting a 1968 

Presession, 2. Teaching experimental design, 

3. Writing a Look, 4. Designing a new c<^urse. 

2. a. Can you point to some specific use you have made of th^? 
ski J Is aiid knowledge acquired at the 1967 Prescssioi;? 

- 46 :-;o - 0 

No rpspf:>nse -* I 



Yes 



(Circle o*.e) 



If "Yes" 
freq. 


, what use (s) ? 




n 


1. 


In the design ov analysis of 
by me . 


research performed 


25 


2. 


In consulting v^7i th collegues . 




25 


3. 


In consulting with others on 
analysis of experiments. 


the design and 


20 


4. 


In teaching my classes. 




3_6 


5. 


I n £idvi B ing graduate students 


engaged in research 


— ^ 


6. 


Other . Please specify: 




Have 


you 


, felt more competent to read 


tiie research 



literature in your research specialty over the past 
15 montiis than before a_s a result of the 1967 Presessions ? 

Yes 40 No - 7 (Circle one) 

Have you felt .Tiore CL.mpetent to design and analyze 
experiments over the past 15 months as a result of the 
1967 Presessions? 



Yes - 4G No - 1 (Circle one) 

Have you AU^itten a research paper-either published or 
unpublished-which benefited from your attendance at 
the 1967 Presession? 

Yes -27 No -19 (Circle one) 

No response - I 

1. If "Yes", vind if the paper or papers were published, 
v;hcie were t]iey or will they be published? 

J. hd. Psych. - 3; USOE Report - 2; Amer, J. Ment. Def. 
J. Ed, Res. - 2 ; Reading Teacher; Child Devel.; 

J. ilurn. Res.; Psych, in Schools; J. Great. Bev^. ; 

Read. Res. Quar.; EPIE Forum. 

Have the conditions of your employment changed wholly 
or part, tally t’s a result of your attendance at the 
1967 Pro session? 

/os - 7 No - 39 (Circle one) 

No response - 1 

If "Yes", please explain; was made Res. Dir. at SUNY ; 
increase in teaching exper. des.; directs research of 
graduate students. 



b. Have you taken a more active interest in seme professional 
organization (e.g., AERA, ASCD) as a result of the 1967 
Presession? 



Yes - 16 



No - 31 (Circle one) 



If "Yes"’, which organization: AERA named 
Other organizations named were PDK, Amer. 
Res. Assoc., ASCD, Can. Ed. Res. Assoc. 



14 times. 
Voc . Ed . 



6. Please rank each of the following activities from I (most 
valuable) to 5 (least valuable) in terms of the value of 
the activities for your professional grov/th: 



Average R ank 



Activi ty 



1.71 
3. 02 
2. 69 
3^_87 

3.71 



A- pos t “dost oral fellowship for a year of study 
An AERA Presession like the one you attended. 
An eight- week " summer institute" . 

Self-study from textbooks. 
h semester- long academic course . 



The responses to item #1 indicate that in almost all cases 
(41 out of 47) the 1967 Presession acted as a stimulus to further 
study. Study of the subject matter did not cease with the end 
of the five-day sessions but was extended through self-study 
of textbooks. From the wording of the question, we may assume 
that these extended efforts at self-improvement can be attributed 
to attendance at the 1967 Presession. 



V7e see in item ^2 that the skills acquired during the 1967 
Presession were appJied in educational research endeavors. 

About 80% of the respondents reported that the Presession 
helped them in advising graduate students engaged in research. 
About 601 of the respondents reported using the skills they 
acquired in designing and analyzing their own research. More 
than half of the respondents were helped in consulting with 
their colJeagues and others on research design and analysis. 
Soniowhat less than half of the respondents made use of the 
ncwly-acqui red skills in their teaching. A "spread of effect" 
of instruction is evident in the responses to item #2, Indeed, 
it is probably no exaggeration to say that literally hundreds 
of persons (students, faculty members, public school personnel, 
etc,) benofited-to a greater or lesser extent-from the instruction 
given to 70 participants in tlie 1967 Design and Analysis 
Presession . 







In item #3, it is seen clearly that in the opinion of the 
respondents, partici,. atior in the 1967 Presession resulted in 
increased research competence which was not transitory, but 
was maintained 15 months after the Presession. 

In item #4, about 60% of the respondents indicated that the 
skills acquired in the 1967 Presession were put to use in 
reporting published or unpublished research. As can be seen 
under 4(a), an impressive array of professional journals are 
the benefactors of instruction at the 1967 Design and Analysis 
Presession . 

Seven out of 47 persons indicated in item #5 that the 
conditions of their employment were changed as a result of 
of attendance at the 1967 Presession. In all but one instance, 
the "change" was one of emphasis and responsibility at the 
participant’s previous place of employment instead of a change 
of place of employment. In part(b) of #5, 14 of 47 persons indi- 
cated that they have taken a greater interest in AERA as a result 
of attendance at the 1967 Presession, 

Item ^#6 is of particular interest. Respondents v;3re asked 
to rank five educational activities from 1 (most valuable) to 
5 (least valuable) in terms of their professional growth. 

Average ranks were calculated for the rankings of the 47 
respondents. The lower the average rank/ the more valuable the 
activity was considered to be by the group of respondents. 

Attendance at an AERA Presession v;as ranked third among the five 
activities. The respondents considered the Presession more valuable 
than taking a semester-long academic course or self-study from 
textbooks. Indeed, attendance at a Presession was considered 
only slightly less valuable than attendance at an eight-week 
long "suiruner Institute". 

Conclusion; Th e effects of a 1967 Prcsession were maintaine d 
over 15 months, were spread to the colleagues and students of 
the participants, and were considered only slightly less valuable 
than those which might result f vom attendance at an eight-week 
"summer institute". 
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